Test of Difference

(Non-Parametric)
Mann-Whitney U Test
• Research Question: Is there be statistically significant differences
on [ordinal dependent variable name here] by [independent variable
here]?
• Ho: There will be no statistically significant differences on [ordinal
dependent variable name here] by [independent variable here].
• Ha: There will be statistically significant differences on [ordinal
dependent variable name here] by [independent variable here].
Mann-Whitney U Test
• The Mann-Whitney U test is the nonparametric equivalent to the
independent t-test and the appropriate analysis to compare
differences that come from the same population when the
dependent variable is ordinal (Leech, Barrett & Morgan, 2005).
• The Mann-Whitney U test compares the number of times a score
from one sample is ranked higher than a score from another sample.
• The scores from both samples will be ranked together; rank 1 is used
for the lowest score, rank 2 for the next lowest score, and so on.
When scores have the same value, a tie is determined. The scores are
ranked and those ranks are added together and then divided by the
number of scores.
Mann-Whitney U Test
• Each of the tied scores is then assigned the same ranking (Cramer,
1998). Once the data is ranked, calculations will be carried out on the
ranks. Given the nonparametric nature of this statistical analysis,
there are fewer assumptions to assess.
• The data must come from random samples of the population, the
data are independent, meaning that scores from one participant are
not dependent on scores of the others, and the measure of the two
samples have at least an ordinal scale of measurement (Brace, Kemp
& Sneglar, 2006).
Assumptions for Mann-Whitney U Test
• Non Parametric of the nature of the data
• Two Independent Groups
• The type of data is interval/ratio
• Counterpart of Independent T-Test
Wilcoxon Signed Rank Test
• The Wilcoxon Signed Rank test is a non-parametric analysis that
statistically compared of the average of two dependent samples and
assess for significant differences.
• The Wilcoxon sign test is the non-parametric alternative of
the dependent samples t-test or the Paired T-test.
• The Wilcoxon Sign test is a repeated measures test of dependency.
This test is mathematically similar to conducting a Mann-Whitney U-
test (which is sometimes also called Wilcoxon 2-sample t-test). It is
also similar to the basic principle of the dependent samples t-test,
because just like the dependent samples t-test the Wilcoxon sign test,
tests the difference of observations when the observations are
matched.
Research Question:
• Does a particular diet drug have an effect on BMI when tested one
the same individuals?
Assumptions
• Data comes from two matched, or dependent, populations.
• The data is continuous.
• Because it is a non-parametric test it does not require a special
distribution of the dependent variable in the analysis.
Kruskal-Wallis test (H-Test)
• The Kruskal-Wallis test is a nonparametric (distribution free) test, and
is used when the assumptions of one-way ANOVA are not met. Both
the Kruskal-Wallis test and one-way ANOVA assess for significant
differences on a continuous dependent variable by a categorical
independent variable
• In the ANOVA, we assume that the dependent variable is normally
distributed and there is approximately equal variance on the scores
across groups. However, when using the Kruskal-Wallis Test, we do
not have to make any of these assumptions.
Hypotheses
• Null hypothesis: Null hypothesis assumes that the samples (groups)
are from identical populations.
• Alternative hypothesis: Alternative hypothesis assumes that at least
one of the samples (groups) comes from a different population than
the others.
Research Questions
• How do test scores differ between the different grade levels in
elementary school?
• Do job satisfaction scores differ by race?
Analysis
• The distribution of the Kruskal-Wallis test statistic approximates a chi-
square distribution, with k-1 degrees of freedom, if the number of
observations in each group is 5 or more. If the calculated value of the
Kruskal-Wallis test is less than the critical chi-square value, then the
null hypothesis cannot be rejected. If the calculated value of Kruskal-
Wallis test is greater than the critical chi-square value, then we can
reject the null hypothesis and say that at least one of the samples
comes from a different population.
Assumptions
• 1. We assume that the samples drawn from the population are
random.
2. We also assume that the observations are independent of each
other.
3. The measurement scale for the dependent variable should be at
least ordinal.
Friedman Test
• The Friedman test is a non-parametric test used to test for differences
between groups when the dependent variable is at least ordinal
(could be continuous).
• The Friedman test is the non-parametric alternative to the one-way
ANOVA with repeated measures (or the complete block design and a
special case of the Durbin test).
• If the data is significantly different than normally distributed this
becomes the preferred test over using an ANOVA.
Assumptions
• There is one group of test subjects that are measured on three or
more different occasions.
• The group is a random sample from the population.
• The dependent variable is at least an ordinal or continuous (Likert
scales, time, intelligent, percentage correct, etc.)
• The samples need not be normally distributed.
Hypotheses
• The null hypothesis is median treatment effects of the population are
all the same. In short, the treatments have no effect.
• The alternative hypothesis is the effects are not all the same.
Indicating there is a discernible difference in treatment effects.
Post Hoc Analysis
• post hoc analysis (from Latin post hoc, "after this") consists
of statistical analyses that were not specified before the data was
seen. This typically creates a multiple testing problem because each
potential analysis is effectively a statistical test. Multiple testing
procedures are sometimes used to compensate, but that is often
difficult or impossible to do precisely. Post hoc analysis that is
conducted and interpreted without adequate consideration of this
problem is sometimes called data dredging by critics because the
statistical associations that it finds are often spurious.
Assumptions:
• If the nature of the data is Parametric (Normal Distributed)
-Posthoc-Scheffe Test
• If the nature of the data is Non- Parametric (Abnormal Distributed)
- Posthoc-Pairwise test