Sei sulla pagina 1di 52

McNemar's test

What is McNemar
 Test is used to determine if there are differences on a

dichotomous dependent variable between two related groups.


 It can be considered to be similar to the paired-samples t-test,

but for a dichotomous rather than a continuous dependent


variable.
 Test used to analyze pretest-posttest study designs, as well

as being commonly employed in analyzing matched pairs


and case-control studies.

II. INTRODUCTION

2
INTRODUCTION

Example
▰ Determine whether the proportion of participants who had low self-esteem
(as opposed to high self-esteem) before a series of counselling sessions
(i.e., an intervention) decreased after the intervention (i.e., your dependent
variable would be "level of self-esteem", which has two categories: "low"
and "high").
▰ Use the McNemar's test to determine whether the proportion of participants
who felt safe (yes or no) differed when wearing a cycling helmet as opposed
to wearing no cycling helmet (i.e., the dependent variable would be "sense
of safety", which has two categories: "safe" and "not safe").
3

This "quick start" guide shows you how to carry out a
McNemar's test using SPSS Statistics, as well as
interpret and report the results from this test. However,
before we introduce you to this procedure, you need to
understand the different assumptions that your study
design must meet in order for a McNemar's test to be an
appropriate choice of test.

4
The McNemar's test has three assumptions that
must be met. If these assumptions are not met,
you cannot use a McNemar's test, but may be able
to use another statistical test instead. Therefore, in
order to run a McNemar's test, you need to check
that your study design meets the following three
assumptions:

II. ASSUMPTIONS

5
II. ASSUMPTIONS

Assumption #1: Examples


Dichotomous variables include perceived safety (two
You have one groups: "safe" and "unsafe"), exam performance (two
categorical dependent groups: "pass" and "fail"), preferred choice of cereal
variable with two brand (two groups: "brand A" and "brand B"), feeling
categories of seasickness (two groups: "yes" and "no"), level of
(i.e.,adichotomous varia exhaustion (two groups: "low" and "high"), use of
ble) and one categorical safety equipment (two groups: "uses safety helmet"
independent variable and "doesn't use safety helmet), skin cream
with two related groups. effectiveness (two groups: "rash" and "no rash"), and
so forth.

6
II. ASSUMPTIONS

Assumption #2: Examples


Imagine you were using a McNemar's test to determine whether the
proportion of participants who passed an exam (as opposed to
The two groups of failing the exam) before a two week revision period (i.e., an
your dependent intervention) increased after the intervention (i.e., your dependent
variable must variable would be "exam performance", which has two categories:
be mutually "pass" and "fail").
exclusive. When a participant took the exam before the two week revision
period, they could have only "passed" it or "failed" it. They could not
pass and fail at the same time (e.g., they either got 60 out of 100
marks and above, which was a "pass", or 59 marks and below,
which was a "fail"). Similarly, after the two week revision period, the
participant could still only either pass or fail the exam.
7
II. ASSUMPTIONS

Assumption #3: Examples


A researcher wanted to investigate the impact of an intervention on smoking. In
this hypothetical study, 50 participants were recruited to take part, consisting of
The cases (e.g., 25 smokers and 25 non-smokers. All participants watched an emotive video
participants) are a showing the impact that deaths from smoking-related cancers had on families.
random sample from Two weeks after this video intervention, the same participants were asked
the population of whether they remained smokers or non-smokers.
interest. However, in Therefore, participants were categorized as being either smokers or non-
practice, this is not smokers before the intervention and then re-assessed as either smokers or non-
always how sampling smokers after the intervention. Due to the same participants being measured
took place. twice, we have paired-samples. We also have a dependent variable that is
dichotomous with two mutually exclusive categories (i.e., "smoker" and "non-
smoker"). As a result, a McNemar's test is the appropriate choice to analyze the
data. 8
For a McNemar's test, you will have either two or three variables:

(1) The dichotomous responses for the first of your related groups (e.g., Before,
which reflects whether participants were "Non-Smokers" or "Smokers" before the
video intervention);

(2) The dichotomous responses for the second of your related groups (e.g., After,
which reflects whether participants were "Non-Smokers" or "Smokers" after the
video intervention); and

III. SETUP in SPSS STATISTICS

9
Setup in SPSS Statistics

▰ For a McNemar's test, you will have either two or three variables:

(1) The dichotomous responses for the first of your related groups
(e.g., Before, which reflects whether participants were "Non-
Smokers" or "Smokers" before the video intervention);

(2) The dichotomous responses for the second of your related


groups (e.g., After, which reflects whether participants were "Non-
Smokers" or "Smokers" after the video intervention); and
10
▰ (3) The frequencies (i.e., total counts) for the four possible paired combinations:
(a) "Non-Smoker" before and after the intervention; (b) "Non-Smoker" before the
intervention, but a "Smoker" after the intervention; (c) "Smoker" before and after
the intervention; and (d) "Smoker" before the intervention, but a "Non-Smoker" after
the intervention. This is captured in the variable, Freq.
▰ In the diagram below, we show you how you would have set up your data in
the Data View of SPSS Statistics if you had entered your data using: (a) the
individual scores for each participant (shown in the diagram on the left below),
where you only have two variables; or (b) total count data, also known as
frequencies (shown in the diagram on the right below), where you have three
variables. 11
12
▰ If you are unsure how to correctly enter these variables into the Variable
View and Data View of SPSS Statistics so that you can carry out your
analysis, we show you how to do this in our enhanced McNemar's test
guide. Just remember that if you have entered your data using total
count data (i.e., frequencies), shown in the diagram on the right above,
you will also have to weight your cases before you can analyze your data
(i.e., this is an additional procedure in SPSS Statistics). You can learn
about our enhanced data setup content in general here or subscribe to
the site here to access our enhanced McNemar's test guide.

13
Test Procedure in SPSS Statistics

▰ The three steps below show you how to analyze your data using a
McNemar's test in SPSS Statistics. We show you the legacy
procedure in SPSS Statistics below rather than the 'new'
procedure that SPSS Statistics has introduced because the legacy
approach can be used in the recent versions of SPSS Statistics (up to
version 22), as well as older versions (version 17 and older). At the
end of these three steps, we show you how to interpret the results
from this test.

14
1

▰ For SPSS Statistics versions 18 to 22, click Analyze


> Nonparametric Tests > Legacy Dialogs > 2 Related
Samples... on the main menu (as shown below) but,
for older versions of SPSS Statistics, click Analyze
> Nonparametric Tests > 2 Related Samples... on the
main menu.

15
16
You will be
presented
with
the Two-
Related-
Samples
Tests dialo
gue box, as
shown
below:

17
Transfer the
variables Before and Afte
r into the Test Pairs: box.
To do this, highlight
both variables by
clicking on one
(e.g., Before), then
holding down the shift-
key, click the other
variable (e.g., After).
Now, click the button.
You will end up with a
screen similar to the
one below:

18
▰ Explanation: The Test Pairs: box is where you enter the dependent variable(s) you
want to analyze You can transfer more than one dependent variable into this box
to analyze many dependent variables at the same time.
▰ Note: By default, SPSS Statistics uses a statistical significance level of .05 and
95% confidence intervals. This equates to declaring statistical significance at
the p < .05 level. If you need to change these values in line with your study design
(e.g., a statistical significance level of .01 and 99% confidence intervals), you can
only do this using SPSS Statistics's newer nonparametric procedure, which
provides far more options than the legacy procedure above. We show you how to
use the newer nonparametric procedure in our enhanced McNemar's test guide.
19
3. Click the button to generate the output.

▰ Output of the McNemar's test in SPSS Statistics


▰ SPSS Statistics generates two main tables of output for
McNemar's test when using the legacy procedure:
the Crosstabulation table and Test Statistics table.
These are discussed in turn below:

20
Cross tabulation Table
It is important when reporting a McNemar's test
result that you also interpret and report
descriptive statistics in order to get a 'feel' for
your data, as well as to provide an appropriate
description of your data. One important measure
that we can report is the proportion of
participants that were non-smokers both prior to
and after the intervention. This is illustrated in the
results generated in the Crosstabulation table
(called the Before & After table in our example),
as shown below:
21
▰ Note: You will notice that the table is named after
the two variables in our analysis
(i.e., Before and After). As such, unless you are using
the same variable names as in this example, your
table will have a different title reflecting the names
of the variables in your analysis.

22
Consulting the bottom-left cell first, you can see that there were 16
participants that were originally smokers, but following the intervention, they
became non-smokers. In the sense that the intervention was designed to
reduce smoking, these participants could be considered the intervention's
successes. However, by consulting the top-right cell, you can see that five
non-smokers actually took up smoking following the intervention! Clearly, this
is not the effect you were looking for, and it is important that you note this in
your report. So, although overall there were more 'positive' changes than
'negative' changes, it can be enlightening to know the different 'directions of
travel' that the participants took.

23
Now that we know that the proportion
of non-smokers increased following
the intervention, we would like to
know whether this difference is
statistically significant. To know this,
we can use the result of McNemar's
test, which can be found in the Test
Statistics table below:

Test Statistics Table

24
▰ If the statistical significance level (i.e., p-value) is less than .05 (i.e., p < .05), you
have a statistically significant result and the proportion of non-smokers before
and after the intervention is statistically significantly different. Alternatively,
if p > .05, you do not have a statistically significant result and the proportion of
non-smokers before and after the intervention is not statistically significantly
different (i.e., the proportion of non-smokers does not change over the course of
the intervention). In our example, p = .027 (using the exact p-value), which
means that the proportion of non-smokers is statistically significantly different
after the intervention as compared to before. Put another way, the change in the
proportion of non-smokers following the intervention was statistically
significant.
25
▰ Note: You will notice that we reported the exact p-value of p = .027
(i.e., Exact Sig. (2-tailed)). When you carry out your own analysis, you may
not have this exact p-value, but an asymptotic p-value instead (i.e., Asymp.
Sig.). This is because SPSS Statistics calculates the p-value differently
depending on the number of discordant pairs in your Crosstabulation table
(i.e., the first table of output we showed you above). To understand the
differences between these two types of p-value, and how to interpret and
report them for your results, see our enhanced McNemar's test guide. You
can subscribe to this enhanced guide and all of our content here.

26
Based on the results above, we could report the results
of the study as follows:

Reporting the output of the


McNemar's test

27
Reporting the output of the McNemar's test

▰ Based on the results above, we could report the results


of the study as follows:

General
Fifty participants were recruited to take part in an intervention designed to warn about the
dangers of smoking. An exact McNemar's test determined that there was a statistically
significant difference in the proportion of non-smokers pre- and post-intervention, p = .027.

Note:
If your results used the asymptotic p-value rather than the exact p-value, we would suggest
reporting this differently to take into account the differences between the two values.

28
▰ In our enhanced McNemar's test guide, we show you how to incorporate the
descriptive information from the Crosstabulation table (i.e., the Before &
After table) into your write-up, as well as how to distinguish between
asymptotic and exact p-values. We also show you how to write up the results
using the Harvard and APA styles. You can learn more about the McNemar's
test, how to accurately set up your data in SPSS Statistics, and how to
interpret and write up your findings in more detail in our enhanced
McNemar's test guide, which you can subscribe to here

29
THANKS!

30
BIG CONCEPT
Bring the attention of your audience over a
key concept using icons or illustrations

31
YOU CAN ALSO SPLIT YOUR CONTENT

White Black
Is the color of milk and fresh Is the color of coal, ebony, and
snow, the color produced by the of outer space. It is the darkest
combination of all the colors of color, the result of the absence
the visible spectrum. of or complete absorption of
light.

32
IN TWO OR THREE COLUMNS

Yellow Blue Red


Is the color of gold, Is the colour of the Is the color of blood,
butter and ripe clear sky and the deep and because of this it
lemons. In the sea. It is located has historically been
spectrum of visible between violet and associated with
light, yellow is found green on the optical sacrifice, danger and
between green and spectrum. courage.
orange.

33
A PICTURE IS WORTH A THOUSAND WORDS

A complex idea can be


conveyed with just a single
still image, namely making it
possible to absorb large
amounts of data quickly.

34
Want big impact?
USE BIG IMAGE

35
USE CHARTS TO EXPLAIN YOUR IDEAS

White Gray Black

36
AND TABLES TO COMPARE DATA

A B C

Yellow 10 20 7

Blue 30 15 10

Orange 5 24 16
37
MAPS

OUR OFFICE

38
89,526,124
Whoa! That’s a big number, aren’t you proud?

39
89,526,124$
That’s a lot of money

185,244 users
And a lot of users

100%
Total success!
40
OUR PROCESS IS EASY

first second last

41
LET’S REVIEW SOME CONCEPTS

Yellow Blue Red


Is the color of gold, butter and ripe Is the colour of the clear sky and Is the color of blood, and because
lemons. In the spectrum of visible the deep sea. It is located of this it has historically been
light, yellow is found between between violet and green on the associated with sacrifice, danger
green and orange. optical spectrum. and courage.

Yellow Blue Red


Is the color of gold, butter and ripe Is the colour of the clear sky and Is the color of blood, and because
lemons. In the spectrum of visible the deep sea. It is located of this it has historically been
light, yellow is found between between violet and green on the associated with sacrifice, danger
green and orange. optical spectrum. and courage.

42
GRAPH TITLE

You can insert graphs from Google Sheets 43


ANDROID PROJECT
Show and explain your
Place your screenshot here
web, app or software
projects using these
gadget templates.

44
iPHONE PROJECT
Show and explain your
web, app or software Place your screenshot here

projects using these


gadget templates.

45
TABLET PROJECT
Show and explain your
web, app or software Place your screenshot here

projects using these


gadget templates.

46
DESKTOP PROJECT
Show and explain your Place your screenshot here

web, app or software


projects using these
gadget templates.

47
CREDITS

Special thanks to all the people who made and


released these awesome resources for free:
▰ Presentation template by SlidesCarnival
▰ Photographs by Startup Stock Photos

48
PRESENTATION DESIGN

This presentation uses the following typographies and colors:


▰ Titles: Roboto Condensed
▰ Body copy: Roboto Condensed
You can download the fonts on this page:
https://material.io/guidelines/resources/roboto-noto-fonts.html

Navy #3f5378 · Dark navy #263248 · Yellow #ff9800

You don’t need to keep this slide in your presentation. It’s only here to serve you as a design guide if you need to create
new slides or download the fonts to edit the presentation in PowerPoint®

49
HELLO!
I am Jayden Smith
I am here because I love to give presentations.
You can find me at @username

50
SlidesCarnival icons are editable shapes.

This means that you can:


● Resize them without losing quality.
● Change line color, width and style.

Isn’t that nice? :)

Examples:

51
😉
Now you can use any emoji as an icon!
And of course it resizes without losing quality and you can change the color.

How? Follow Google instructions


https://twitter.com/googledocs/status/730087240156643328

✋👆👉👍👤👦👧👨👩👪💃🏃💑❤😂
😉😋😒😭👶😸🐟🍒🍔💣📌📖🔨🎃🎈
🎨🏈🏰🌏🔌🔑 and many more...
52

Potrebbero piacerti anche