Non-Parametric Analysis

27 Nov 2009 CPSY501 Dr. Sean Ho Trinity Western University

Please download: relationships.sav Field-Looks_Charis.sav

Outline for today

Non-Parametric

et!een-s"#$ects Tests%

2 &ro"'s% (ann-W)itney U (any &ro"'s% *r"s+a,,-Wa,,is H -actoria, variants

Non-Parametric Wit)in-s"#$ects Tests%

2 re'etitions% Wi,co.on Si&ne/-ran+ (any re'etitions% -rie/man0s 1N231

T)ere e.ist ot)er non-'arametric o'tions4 too5

When To Use Non-Parametric

6evie!% ass"m'tions o7 1N2318
97 met4 'arametric met)o/s more 'o!er 1N231 is 'retty ro#"st to non-norma,ity Try trans7ormin& /ata4 or m",ti-,eve, mo/e,

Consi/er non-'arametric a,ternatives i7%

D3 is or/ina,4 or 3io,ations are severe eno"&) to a77ect res",t

Non-'arametric o7ten "se ran+s4 not ra! scores

e.&.4 S'earman vs. Pearson corre,ation Com'arin& me/ians rat)er t)an means

Mann-Whitney U Test
D3% or/ina, or sca,e4 #"t non-'arametric 93% /ic)otomo"s4 #et!een-s"#$ects :2 &ro"'s; 6<% 9s t)ere a me/ian /i77erence #et!een t)e

t!o &ro"'s8

Non-'arametric a,ternative to t-test

W)at researc) /esi&ns mi&)t nee/ t)is test8 Data entry 7ormat%

2 varia#,es entere/ 7or eac) 'artici'ant%

93% &ro"' mem#ers)i' :0 or 1; D3% o"tcome meas"re

Mann-Whitney U: SPSS
Dataset% re,ations)i's.sav 1na,y=e > Non'arametric > 2 9n/e'en/ent%
Test 3aria#,e% D3 :?"a,ity o7 comm"nication; @ro"'in& 3aria#,e% 93 :)avin& co"nse,,in&; Use ADe7ine @ro"'sB to c)oose t!o &ro"'s

7or com'arison% 1C no co"nse,D 2 C )a/ co"nse,

Test Ty'e% A(ann-W)itney UB

2'tiona, SPSS mo/",e 7or E.act Tests%

Com'"tationa,,y-e.'ensive #"t more 'recise4 es'ecia,,y 7or sma,, F "n#a,ance/ /esi&ns

Mann-Whitney U: Output
AT)ere !as no si&ni7icant e77ect o7 Havin& Co"nse,,in& on <"a,ity o7 Comm"nication4 U C G11.004 p C .0594 (/nH C H.04 (/nN C G.0.B
Use 1na,y=e > Descri'tives > E.',ore to &et

&ro"' me/ians

Test Statisticsa "#ality o$ %omm#n cation 311.000 1014.000 -1.890 .059

Mann-Whitney U Wilcoxon W Z Asymp. Sig. (2-taile !

a. &'o#ping (a'ia)le* +a any co#nselling

Mann-Whitney U: Effect Size

E77ect si=e m"st #e ca,c",ate/ man"a,,y4 "sin&

t)e 7o,,o!in& 7orm",a%

r C I F JN

e.&.4 r C -1.K9 F JL0 M -0.2HH99

Use e.istin& researc) or Co)enNs e77ect si=e

AestimatesB%

AT)ere is a sma,, /i77erence #et!een t)e

t)era'y an/ no t)era'y &ro"'s4 r C -.2HB

Practise: Mann-Whitney U
Yo" try it5 9s t)ere a si&ni7icant /i77erence #et!een

s'o"ses !)o re'ort comm"nication 'ro#,ems an/ s'o"ses !)o )ave not :AComO'ro#B;4 in terms o7 t)e ,eve, o7 con7,ict t)ey e.'erience :ACon7,ictB;8
W)at is t)e si=e o7 t)e e77ect8

rus!al-Wallis Test
D3% or/ina, or sca,e4 #"t non-'arametric 93% cate&orica,4 #et!een-s"#$ects :many &ro"'s; 6<% 9s t)ere a me/ian /i77erence amon&st t)e

&ro"'s8

1,ternative to 2ne-!ay 1N231

W)at researc) /esi&ns mi&)t nee/ t)is test8 Data entry 7ormat%

2 varia#,es entere/ 7or eac) 'artici'ant%

93% &ro"' mem#ers)i' D3% o"tcome meas"re

rus!al-Wallis: SPSS
1na,y=e > Non'arametric > * 9n/e'en/ent%
Test 3aria#,e% D3 :,eve, o7 con7,ict; @ro"'in& 3aria#,e% 93 :ty'e o7 co"nse,,in&; Test Ty'e% A*r"s+a,-Wa,,is HB De7ine @ro"'s% s'eci7y )i&)est an/ ,o!est

&ro"' n"m#ers to #e com'are/

2'tiona, SPSS mo/",e 7or E.act Tests%

Com'"tationa,,y-e.'ensive #"t more 'recise4 es'ecia,,y 7or sma,, F "n#a,ance/ /esi&ns

rus!al-Wallis: Output
ATy'e o7 co"nse,,in& )as a si&ni7icant e77ect on 'artici'ants0 ,eve, o7 con7,ict4 P2:2; C 7.094 p C .029.B
1,so re'ort me/ians an/ 'ost )oc res",ts...
Test Statisticsa,b -e.el o$ %on$lict 7.094 2 .029

%hi-S,#a'e $ Asymp. Sig.

a. /'#s0al Wallis 1est ). &'o#ping (a'ia)le* 1ype o$ %o#nselling

rus!al-Wallis: "ollo#-up
*-W test is omni#"s% i7 si&ni7icant4 7o,,o!-"'

!it) (ann-W)itney tests on 'airs o7 &ro"'s

("st /o

on7erroni correction man"a,,y4 or e,se Ty'e 1 error in7,ates% ,o!er t)e ,eve, o7 si&ni7icance to 0.05 F :Q com'arisons;

Try ',anne/ contrasts #ase/ on

T)eory F ,iterat"re4 Yo"r researc) ?"estionD or 2r/erin& &ro"'s #y mean ran+s4 an/

com'arin& eac) &ro"' to ne.t )i&)est &ro"'

rus!al-Wallis: Effect Size

2vera,, e77ect si=e not so "se7",D instea/4 Ca,c",ate e77ect si=e 7or eac) 'air o7 &ro"'s t)at

/i77ers si&ni7icant,y :in (ann-W)itney 7o,,o!-"';

r C I F Jn W)ere t)e sam',e si=e n is t)e tota, n"m#er

o7 'artici'ants in t)is 'air o7 &ro"'s

rus!al-Wallis: $eportin%
ATy'e o7 Co"nse,,in& )as a si&ni7icant e77ect on

'artici'ants0 ,eve, o7 con7,ict4 P2:2; C 7.094 p C .029.B

AS'eci7ica,,y4 t)e No Co"nse,,in& &ro"' )a/

)i&)er con7,ict scores4 (/nN C H.04 t)an /i/ t)e Co"',es Co"nse,,in& &ro"'4 (/nC C G.04 (ann-W)itney U C 17L.54 Z C -2.L14 p C .0094 r C -.G7. on7erroni correction% R C .05 F G M .017

-ie,/ "ses AHB 7or t)e *-W% H:2; C 7.09 Note%

rus!al-Wallis: Non-si%nifcant
97 *r"s+a,-Wa,,is &ives a non-si&ni7icant res",t4

#"t t)e researc) ?"estion #e)in/ t)e ana,ysis is sti,, Aim'ortantB%

T)e 'ro#,em mi&)t #e !it) ,o! 'o!er4 so Descri'tive 7o,,o!-"' ana,yses can #e )e,'7",. See t)e i,,"stration 7or -rie/manNs 1N231 #e,o!

7or some c,"es.

Parametric &s' Non-Parametric

T)ere0s not)in& !ron& !it) r"nnin& #ot)

'arametric an/ non-'arametric tests5

Com'arison o7 non-'arametric tests !it) t)e

corres'on/in& 1N231 may #e a#,e to ,en/ more con7i/ence in t)e overa,, a/e?"acy o7 t)e 'atterns re'orte/. ,ess 'o!er 7or !e,,-/istri#"te/ D3s4 #"t t)ey can #e more sensitive to e77ects !)en t)e D3 is4 7or instance4 tr",y #imo/a,5

Non'arametric ana,yses ten/ to )ave

Param &s' Non-Param: e('

97 !e /o t)e same ana,ysis 'arametrica,,y%
D3% Seve, o7 Con7,ict 93% Ty'e o7 Co"nse,,in& 2ne-!ay 1N2314 !it) Sevene0s test an/

on7erroni 'ost-)oc
6es",ts are simi,ar% F:24 57; C H.054 p C .02G
T)e No Co"nse,,in& &ro"' s)o!s more

con7,ict t)an t)e Co"',es Co"nse,,in& &ro"'4 (N C G.K7 an/ (C C G.0H

Con7irms res",ts !it) non-'arametric ana,ysis

"actorial )et#een-Su*+ects
SPSS /oesn0t )ave 7actoria, #et!een-s"#$ects

non-'arametric ana,yses #"i,t-in5

Try creatin& one 93 t)at enco/es a,, ce,,s%

e.&.4 2.G 7actoria, > L-,eve, one-!ay4 "se *-W

:-; -o,,o!-"' &ets )ar/ !it) ,ots o7 &ro"'s :-; (o/erationFinteraction ana,ysis is )ar/er :T; -,e.i#i,ity in /e7inin& &ro"'s :T; Tar&et s'eci7ic ce,,s F interactions

2r% 6"n se'arate *-W tests 7or eac) 93 2r% Convert to ran+s an/ "se ,o&-,inear ana,ysis

"actorial Analysis: E(ample

6esearc) ?"estion% Ho! /o (arita, Stat"s an/

Ty'e o7 Co"nse,,in& re,ate to Con7,ict Seve,s8

C)ec+ ce,, si=es !it) 1na,y=e > U > Crossta#s%

T)e sma,,est ce,,s :9n/ivi/"a, Co"nse,,in&;

)ave 5-L 'eo',e 'er &ro"'4 t)at is eno"&)

2.G 7actoria, > convert to 1 93 !it) L ,eve,s%

9n/iv. Co"nse, V (arrie/D 9n/iv V Divorce/D

Co"',es Co"ns. V (arrD Co"',e V DivD etc. try t)e A97B con/itions

Trans7orm > 6eco/e into Di77erent4

"actorial Analysis: Output

T)e *r"s+a,,-Wa,,is test 7or t)e com#ine/

varia#,e is not si&ni7icant.

T)is s"&&ests t)at t)e si&ni7icant e77ect 7or

Co"nse,,in& Ty'e is mas+e/ !)en com#ine/ !it) (arita, Stat"s.

"actorial Analysis: Main effect

T)e i/ea o7 a Amas+in& e77ectB o7 (arita, Stat"s

s)o!s as !e,, !)en !e test t)at main e77ect a,one.

Theory-,uided -nteraction Test

Divorce/ V No co"nse,,in& &ro"'%
We mi&)t ass"me t)is &ro"' s)o",/ )ave

)i&) con7,ict ,eve,s5

Com'are !it) some o7 t)e ot)er 5 &ro"'s

"sin& (ann-W)itney U tests

T)is can #e a At)eoretica,,y &"i/e/B

re',acement 7or interaction tests in non-'arametric 7actoria, ana,ysis. #et!een t)e 93s.

T)e c)oice /e'en/s on conce't"a, re,ations

rus!all-Wallis: Practise
Does n"m#er o7 c)i,/ren :ran&e 0-G; )ave a

si&ni7icant e77ect on ?"a,ity o7 marita, comm"nication8

Wilco(on Si%ned-ran! Test

D3% or/ina, or sca,e4 #"t non-'arametric 93% !it)in-s"#$ects4 !it) 2 re'etitions 6<% 9s t)ere a me/ian c)an&e #et!een times8
Para,,e, to 'aire/-sam',es t-test

W)at researc) /esi&ns mi&)t nee/ t)is test8 Data entry 7ormat%

2 varia#,es entere/ 7or eac) 'artici'ant%

D3 at 7irst meas"rement D3 at secon/ meas"rement

Wilco(on Si%ned-ran!: SPSS

1na,y=e > Non'arametric > 2 6e,ate/ Sam',es%
Test Pairs% D3 #e7ore an/ D3 a7ter Test Ty'e% Wi,co.on

Practise% /oes ,eve, o7 con7,ict /ecrease 7rom

're-t)era'y :Pre-con7; to 'ost-t)era'y :Con7,ict;8

(",ti',e 'airs may #e s'eci7ie/ in one ana,ysis
"t no #"i,t-in

on7erroni correction

E.act tests a,so avai,a#,e !it) a//-on mo/",e

Wilco(on Si%ned-ran!: Output

T)ere !as a si&ni7icant re/"ction in ,eve, o7

con7,ict a7ter t)era'y4 T C H.54 p C .002.

Ranks 6

2r% Z C -G.094 p C .002 :V ca,c. e77ect si=e;

8'e-the'apy le.el o$ %on$lict - -e.el o$ %on$lict 6egati.e 7an0s 8ositi.e 7an0s 1ies 1otal 1a 13 ) 45 c 50 Mean 7an0 4.20 4.43 S#m o$ 7an0s 4.50 100.20

Test Statistics b 8'e-the'apy le.el o$ %on$lict -e.el o$ %on$lict -3.094 a .002

a. 8'e-the'apy le.el o$ %on$lict 9 -e.el o$ %on$lict ). 8'e-the'apy le.el o$ %on$lict : -e.el o$ %on$lict c. 8'e-the'apy le.el o$ %on$lict ; -e.el o$ %on$lict

Z Asymp. Sig. (2-taile !

a. <ase on negati.e 'an0s. ). Wilcoxon Signe 7an0s 1est

Wilco(on Si%ned: Effect Size

E77ect si=e m"st #e ca,c",ate/ man"a,,y4 "sin&

t)e 7o,,o!in& 7orm",a%

r C I F JN

e.&.4 r C -G.09 F J120 M -0.2K

N is tota, n"m#er o7 o#servations4 not

'artici'ants5 :L0 'artici'ants; W :2 o#servation; AestimatesB%

AT)e re/"ction in ,eve, o7 con7,ict a7ter

Use e.istin& researc) or Co)enNs e77ect si=e

t)era'y !as si&ni7icant #"t sma,,4 r C -.2KB

Wilco(on Si%ned-ran!: Practise

Do ,eve,s o7 con7,ict c)an&e si&ni7icant,y

#et!een 're-t)era'y :PreOcon7; an/ 1 year a7ter t)era'y :-o,,o!Ocon7;8

97 so4 ca,c",ate t)e si=e o7 t)e e77ect.

Partici'ant attrition at time G :-o,,o!Ocon7;

a77ects t)e tota, n"m#er o7 o#servations5

E.am',e re'ortin&% AT)ere !as a si&ni7icant

re/"ction in ,eve, o7 con7,ict a7ter t)era'y4 T C H.5 Xor% Z C -G.09Y4 p C .0024 r C -.2K.B

"riedman.s ANO/A
D3% or/ina, or sca,e4 #"t non-'arametric 93% !it)in-s"#$ects4 severa, re'etitions 6<% 9s t)ere a me/ian c)an&e over time8
Para,,e, to re'eate/-meas"res 1N231

W)at researc) /esi&ns mi&)t nee/ t)is test8 Data entry 7ormat%

one varia#,e 7or eac) re'etition o7 t)e meas"re

D3 at 7irst meas"rement D3 at secon/ meas"rement D3 at t)ir/ meas"rement4 etc.

"riedman.s ANO/A: SPSS

1na,y=e > Non'arametric > * 6e,ate/ Sam',es%
Test 3aria#,es% eac) re'etition o7 D3 Test Ty'e% A-rie/manB

No easy !ay in SPSS to /o non-'arametric

mi.e/-/esi&n ana,ysis
2'tiona, SPSS mo/",e 7or E.act Tests%

Com'"tationa,,y-e.'ensive #"t more 'recise4 es'ecia,,y 7or sma,, F "n#a,ance/ /esi&ns

"riedman0s ANO/A: Output

ASeve,s o7 con7,ict c)an&e/ si&ni7icant,y over

time4 2:24 N C 57; C 9.074 p C .011.B AS'eci7ica,,yUB [report post hoc results...]
Test Statisticsa 6 %hi-S,#a'e $ Asymp. Sig. 57 9.065 2 .011

a. ='ie man 1est

"riedman0s ANO/A: "ollo#-up

97 -rie/manNs is si&ni7icant4 7o,,o!-"' !it) a

series o7 Wi,co.on Si&ne/-ran+s tests%

6emem#er man"a, "t

Eit)er /o a,, 'airs o7 ,eve,s o7 t)e 6( :'ost-)oc;%

on7erroni correction% R C .05 F :Q com'arisons; on7erroni is o7ten too conservative

2r tar&et s'eci7ic ',anne/ com'arisons :#etter;%

e.&.4 :time1 vs. time2;4 :time2 vs. timeG;4 U

+-,eve,s o7 93 > on,y +-1 com'arisons contro, Ty'e 99 error

Use7", i7 'o!er is ,o!4 e.&. many ce,,s%

"riedman0s ANO/A: E(ample

93% Time :G ce,,s; Tar&ete/ 7o,,o!-"' ana,yses%
6"n G Wi,co.onNs si&ne/-ran+ tests on7erroni correction% R C .05 F G M .017

Pre vs. Post% Z C - G.094 p C .0024 r C -.2K Pre vs. 1yr% Z C - 2.HH4 p C .0154 r C -.22 Post vs. 1yr% not si&ni7icant Conc,"sion% im'rovement a7ter t)era'y is

maintaine/ at t)e 7o,,o!-"' assessment.

"riedman0s ANO/A: $eportin%

ASeve,s o7 con7,ict si&ni7icant,y c)an&e/ AS'eci7ica,,y4 con7,ict /ecrease/ 7rom

over time4 P2 :24 N C 57; C 9.074 p C .011. 're-t)era'y ,eve,s at 'ost-t)era'y o#servations4 Z C -G.094 p C .0024 r C -.2K4 ,eve,s one year ,ater4 Z C -2.HH4 p C .0154 r C -.22.B

Aan/ ,eve,s remaine/ #e,o! 're-t)era'y con7,ict

"riedman0s: Non-si%nificance
97 -rie/manNs is not si&ni7icant%
9s it #eca"se o7 ,o! 'o!er :Ty'e 99 error;8

6"n a series o7 Wi,co.on Si&ne/-ran+s tests4 #"t

-oc"s on e77ect si=es4 not si&ni7icance ,eve,s

97 t)e e77ect si=es are Amo/erateB4 say Z .254

t)en t)e res",ts co",/ #e !ort) re'ortin&. 7or 7"t"re meta-ana,yses.

Eno"&) /etai, s)o",/ #e re'orte/ to #e "se7", T)is co",/ #e tr"e o7 any ana,ysisD

!e $"st "se -rie/man0s to i,,"strate

"riedman0s ANO/A: Practise

Dataset% -ie,/-Soo+sOC)aris.sav
ASoo+s or Persona,ityB :-ie,/ te.t; T!o 6( 93s in t)e /ataset

6<% 9s t)ere a si&ni7icant /i77erence #et!een

'artici'antsN $"/&ements o7 'eo',e !)o are o7 avera&e ')ysica, a''earance4 #"t 'resent as /",, :AaveOnoneB;D some!)at c)arismatic :AaveOsomeB;4 or as )avin& )i&) c)arisma :AaveO)i&)B;8
97 so4 con/"ct 7o,,o!-"' tests to i/enti7y !)ere

t)e s'eci7ic /i77erences ,ie.

Summary: )et#een-Su*+ects
Parametric
t-test #et!een &ro"'s

Non-Parametric
(ann-W)itney U test *r"s+a,-Wa,,is H test
Post-)oc% (-W

:1 934 /ic)otomo"s;
2ne-!ay 1N231

:1 934 many ,eve,s;

Post-)oc% t-tests

-actoria, 1N231

:severa, 93s;

*-W !it) enco/in& o7

ce,,s in one 93

Post-)oc% t-tests

Post-)oc% (-W

Summary: Within-Su*+ects
Parametric
Paire/Fre,ate/ t-test

Non-Parametric
Wi,co.on Si&ne/-6an+ -rie/man0s 1N231

:1 6( 93 !F2 ,eve,s;
6e'eate/-ms 1N231

:1 6( 93 !it) many ,eve,s;

Post-)oc%

'aire/ t-tests #et!een ,eve,s o7 6(

Post-)oc%

Wi,co.on Si&ne/ran+ #et!een ,eve,s o7 t)e 6(