PLG 500

STATISTICAL REASONING IN
EDUCATION

Lecture 8: TWO WAY ANOVA

(Part I)
Contents
1. Concept of Two Way ANOVA
2. Main Effect and Interaction Effect
3. Hypothesis Testing using SPSS
4. Effect size
5. Multiple Comparison
1. Concept of Two Way ANOVA
Two Way ANOVA
is a statistical method used to
determine the effect of
two independent variables (or factors)
on one dependent variable
The independent variables
are categorical variables,
divided into two or more levels
The dependent variable is a continuous variable
 Example 1
A researcher wants to determine
the effect of a learning method and gender on
the number of English words that can be
remembered by a student
State (a) the independent variables and their levels
(b) the dependent variable
Gender
Male Female
Learning Memorisation Number of English Number of English
method words remembered words remembered
Key words Number of English Number of English
words remembered words remembered
 Answer
Gender
Male Female
Learning Memorisation Number of English Number of English
method words remembered words remembered
Key words Number of English Number of English
words remembered words remembered

(a) independent variable (or factor):

Learning method, with 2 levels: memorisation and key words
Gender, with 2 levels: male and female
(b) dependent variable :
Number of English words remembered
 Factor A with 2
levels

Factor B with 2
levels
2 X 2 factorial design
The research design is known as a 2 X 2 factorial design
This design produces 4 cells. Each cell or treatment condition
represents
the interaction between one level of factor A and one level of factor B.
Example: Cell a1 b1 is the interaction between memorisation and male.

Gender (Factor B)
cell a1 b1
Male (b1) Female (b2)
Memorisation (a1 b1) (a1 b2)
Learning (a1)
method Key words
(Factor A) (a2 b1) (a2 b2)
(a2)
 Example 2
A researcher wants to determine the effect of gender and
length of exercise on students’ performance
State (a) the independent variables and their levels
(b) the dependent variable.

Length of exercise
1 week 2 weeks 3 weeks
Male Performance Performance Performance
Gender score score score
Female Performance Performance Performance
score score score
 Answer
Length of exercise
1 week 2 weeks 3 weeks
Male Performance Performance Performance
Gender score score score
Female Performance Performance Performance
score score score

(a) independent variable (or factor):

Gender, with 2 levels: male and female
Length of exercise, with 3 levels: 1 week, 2 weeks and 3 weeks
(b) dependent variable:
Performance score
 Factor A with 2 levels

Factor B with 3
2 X 3 factorial design levels

The research design is known as a 2 X 3 factorial design

This design produces 6 cells. Each cell or treatment condition
represents
the interaction between one level of factor A and one level of factor B.
Example: Cell a1 b1 is the interaction between male and 1 week.

Length of exercise (Factor B)

1 week (b1) 2 weeks (b2) 3 weeks (b3)
Male (a1 b1) (a1 b2) (a1 b3)
Gender (a1)
(Factor A) Female (a2 b1) (a2 b2) (a2 b3)
(a2)
 Example 3
A researcher wants to determine the effect of a teaching
method and IQ on mathematics performance
State (a) the independent variables and their levels
(b) the dependent variable
IQ
Low Average High
Method Mathematics Mathematics Mathematics
I score score score
Teaching Method Mathematics Mathematics Mathematics
method II score score score
Method Mathematics Mathematics Mathematics
III score score score
 Answer
IQ
Low Average High
Method Mathematics Mathematics Mathematics
I score score score
Teaching Method Mathematics Mathematics Mathematics
method II score score score
Method Mathematics Mathematics Mathematics
III score score score

(a) independent variable (or factor):

Teaching method, with 3 levels:
Method I, Method II dan Method III
IQ, with 3 levels: low, average and high
(b) dependent variable :
Mathematics score
 Factor A, 3
levels
3 X 3 factorial design Factor B, 3 levels

The research design is known as a 3 X 3 factorial design

This design produces 9 cells. Each cell or treatment condition
represents
the interaction between one level of factor A and one level of factor B.
Example : Cell a1 b1 is interaction between Method I and low IQ
IQ (Factor B)
Low (b1) Average (b2) High (b3)
Method I (a1 b1) (a1 b2) (a1 b3)
(a1)
Teaching Method II
method (a2 b1) (a2 b2) (a2 b3)
(a2)
(Factor A)
Method III (a3 b1) (a3 b2) (a3 b3)
(a3)
2. Main Effect and Interaction Effect
Two way ANOVA is used to determine two
types of effect on the dependent variable.
The effects are the result of two factors,
either on its own or in combination with
another:
1.Main effect
2.Interaction effect
Main effect
Main effect of a factor is
the effect of that factor on the
independent variable
There are 2 types of main effects:
Main effect of factor A
Main effect of factor B
 Main effect
Main effect for factor A is the effect of factor A
on the dependent variable, across all levels of
factor B
Main effect for factor B is the effect of factor B
on the dependent variable, across all levels of
factor A
 Interaction effect
Interaction effect between factor A and factor B
is the combined effect of both factors on the
dependent variable
This means that the effect of one factor on the
dependent variable is not the same for the
different levels of the other factor
 Example of main effect of
factor A
A researcher wants to determine the effect of a learning
method and gender on the number of English words
remembered

Gender (Factor B)
Male (b1) Female (b2)
Memorisation
Learning (a1) X 11 = 20 X 12 = 20 X 1 . = 20
method Key words
(Factor A) (a2)
X 21 = 40 X 22 = 40 X 2 . = 40
X .1 = 30 X .2 = 30 X = 30
 Example of main effect of factor A
Gender (Factor B)
Male (b1) Female (b2)
Memorisation
Learning (a1) X 11 = 20 X 12 = 20 X 1 . = 20 Mean row
1
method Key words
(Factor (a2)
X 21 = 40 X 22 = 40 X 2 . = 40 Mean
A) row 2
X .1 = 30 X .2 = 30 X = 30

Mean col 1 Mean col 2

There is a difference between mean of row 1 and mean of

row 2 (i.e. 20 – 40 = -20).
This means here is a main effect of learning method (factor
A) on the number of English words remembered
 Example of main effect of factor A
Gender (Factor B)
Male (b1) Female (b2)
Memorisation
Learning (a1) X 11 = 20 X 12 = 20 X 1 . = 20 Mean row
1
method Key words
(Factor (a2)
X 21 = 40 X 22 = 40 X 2 . = 40 Mean
A) row 2
X .1 = 30 X .2 = 30 X = 30

Mean col 1 Mean col 2

There is no difference between mean of column 1 and mean

of column 2 (i.e. 30 – 30 = 0).
So, there is no main effect of gender (factor B) on the
number of English words remembered
 Example of main effect of factor A
Mean cell a1 b1 Gender (Factor B) Mean cell a1 b2
Male (b1) Female (b2)
Memorisation
Learning (a1) X 11 = 20 X 12 = 20 X 1 . = 20
method Key words
(Factor (a2)
X 21 = 40 X 22 = 40 X 2 . = 40
A)
Mean cell a2 b1 X .1 = 30 X .2 = 30 X = 30
Mean cell a2b2
 The difference between the mean of cell a1 b1 and the mean
of cell a2 b1 (20 – 40 = -20) is the same as the difference
between the mean of cell a1 b2 and the mean of cell a2 b2 (20
– 40 = -20).
 So, there is no interaction effect between factor A and each
level of factor B
 Example of main effect of factor A
Mean cell a1 b1 Gender (Factor B) Mean cell a1 b2
Male (b1) Female (b2)
Memorisation
Learning (a1) X 11 = 20 X 12 = 20 X 1 . = 20
method Key words
(Factor (a2)
X 21 = 40 X 22 = 40 X 2 . = 40
A)
Mean cell a2 b1 X .1 = 30 X .2 = 30 X = 30
Mean cell a2b2
 The difference between the mean of cell a1 b1 and the mean
of cell a1 b2 (20 – 20 = 0) is the same as the difference
between the mean of cell a2 b1 and the mean of cell a2 b2 (40
– 40 = 0).
 So, there is no interaction effect between factor B and each
level of factor A
 Gender (Factor B)
Male (b1) Female (b2)
Memorisation
Learning (a1) X 11 = 20 X 12 = 20 X 1 . = 20
method Key words
(Factor (a2)
X 21 = 40 X 22 = 40 X 2 . = 40
A)
X .1 = 30 X .2 = 30 X = 30
X-axis: factor A
Male Y-axis: mean number of
Mean number of English words

Female English words remembered

Two straight lines represent
remembered

factor B
Both lines are aligned
together. There is no
interaction between factor A
and factor B

Memorisation Key word