22/11/2016

Conrmatory factor analysis vs. Rasch approaches: Differences and Measurement Implications

Confirmatoryfactoranalysisvs.Rasch
approaches:
DifferencesandMeasurementImplications

CFA

Rasch

1Fundamentalandtheoreticalissuesofmeasurement

Conceptof
Measurement

Basedonclassicaltesttheory(CTT)
Numbersareassignedtorespondents'
attributes(Stevens1946,1951)

Themeasureofamagnitudeofa
quantitativeattributeisitsratioto
theunitofmeasurement,theunitof
measurementisthatmagnitudeof
theattributewhosemeasureis1
(Michell1999,p.13)
Measurementistheprocessof
discoveringratiosratherthan
assigningnumbers
RaschModelisinlinewith
axiomaticframeworkof
measurement
Principleofspecificobjectivity

Model

xi=i+ijj+i
xi...manifestitemscore
i...iteminterceptparameter
ij...factorloadingofitemiatfactorj
j...factorscoreoffactorj
i...stochasticerrorterm

Fordichotomousdata:
P(ai=1)=e(i)/[1+e(i)]
ai...responseofpersontoitemi
...personlocationparameter
i...itemlocationparameter
(endorsability)

Measureisdirectlyandlinearlyrelated
totheindicators
Hence,theweightedrawscoreis
consideredtobealinearmeasure

Probabilityofaresponseis
modeledasalogisticfunctionof
twomeasures,theperson
parameterbvandtheitemlocation
(endorsability)di
Rawscoreisnotconsideredtobe
alinearmeasure,transformationof
rawscoresintologits(Wright1996,
p.10)

Relationshipof
measureand
indicators
(items)

In/dependence
ofsamples
Parametersaresampledependent,
and
representativesamplesareimportant
parameters

Itemparametersareindependentof
sampleused(subjecttomodelfit
andsufficienttargeting)

2Itemselectionandsampling(scaleefficiency)issues

Itemselection

Itemsselectedtomaximizereliability,
leadstoitemsthatareequivalentin
termsofendorsabilitywhichplaysno
explicitroleinCTT
Favorsitemsthataresimilartoeach
other(seebandwidthfidelityproblem,
Singh2004)

http://www.rasch.org/rmt/rmt231g.htm

Itemsareselectedtocoverawide
rangeofthedimension(see
'bandwidth',Singh2004)
Endorsabilityofitemplaysakey
role

1/6

22/11/2016

Conrmatory factor analysis vs. Rasch approaches: Differences and Measurement Implications

Discriminationisequalforallitems
toretainacommonorderofall
itemsintermsofendorsabilityforall
respondents

Discriminationvarieswithinan
item(conceptofinformationwhich
equalsP(avi=1)*P(avi=0)inthe
dichotomouscase),itreachesits
maximumatbv=di

Item
discrimination

Discriminationvariesfromitemtoitem
butisconsideredfixedwithinanitem

Targeting

Itemsthatareofftargetmayeven
increasereliabilityandfeignasmall
standarderrorwhichcanactuallybe
quitelarge

Itemsthatareofftargetprovideless
information,standarderrorswill
increaseandthepowerofthetest
offitwilldecrease

Standarderror
of
measurement

Basedonreliability,assumedtobeequal
acrossthewholerange

Basedontheinformationtheitems
yieldforaspecificperson

Samplesize

Therequiredsamplesizemirrors
recommendationsforstructuralequation
modeling(SEM).SEMisnotappropriate
forsamplesizesbelow100.Asaruleof
thumbsamplesizesofgreaterthan200
aresuggested(Boomsma1982Marsh,
Balla,andMcDonald1988).Bentlerand
Chou(1987)recommendaminimum
ratioof5:1betweensamplesizeandthe
numberoffreeparametertobe
estimated.

Ingeneral,thesamplesizesusedin
structuralequationmodelingare
sufficientbutinsufficienttargeting
increasesthesamplesizeneeded.
AccordingtoLinacre(1994)the
minimumsamplesizerangesfrom
108to243dependingonthe
targetingwithn=150sufficientfor
mostpurposes(foritemcalibrations
stablewithin0.5logitsand.99
confidence)

Distributionof
persons

Commonlyassumedtobenormal

Irrelevantduetospecificobjectivity
(subjecttosufficienttargeting)

Missingdata

Problematic,missingdatahastobe
imputed,deletingpersonsmayalterthe
standardizingsample,deletingitemsmay
altertheconstruct,pairwisedeletion
biasesthefactors(Wright1996,p.10)
Mising data akan dikira

Estimationofpersonanditem
parametersnotaffectedbymissing
data(exceptforlargerstandard
errors)

Usuallyinreferencetosamplemean

Inreferencetotheitemsdefining
thelatentdimension

Interpretation
ofperson
measures

Kalau mising data tidak dikira (Haryanti 2016)

3Dimensionalityissues
Apriorimultidimensionalconstructs
aresplitupintoseparate
dimensions

Multi
dimensionality

Multidimensionalityeasilyaccountedfor

Directional
factors

Sensitivitytodirectionalfactors(Singh
Lowsensitivitytodirectionalfactors
2004)incaseofitemswordedindifferent
(Singh2004)
directions

4Investigationofcomparabilityofmeasuresacrossgroups
Assessmentof Multigroupanalysis
scale
Equivalencestatementsofparameters
equivalence
estimatedacrossgroups
http://www.rasch.org/rmt/rmt231g.htm

Differentialitemfunctioning
analysis(DIF)capitalizingonthe
principleofspecificobjectivity
2/6

22/11/2016

Conrmatory factor analysis vs. Rasch approaches: Differences and Measurement Implications

Analysisofresidualsindifferent
groups
Incomplete
equivalence

Partialinvariance(forgroupspecific
ItemsplitduetoDIF(forgroup
itemsseparateloadingsand/orintercepts specificitemsseparateitem
areestimated)
locationsareestimated)

Typical
sequenceand
principalsteps
ofanalysis

Estimationofbaselinemodel(group
specificestimatesofloadingsanditem
intercepts)
equalityconstraintsimposedon
loadings(metricinvariance)
equalityconstraintsimposedon
intercepts(scalarinvariance)
selectedconstraintsliftedifnecessary
(partialinvariance)

estimationofmodelacrossgroups
collapsingofcategoriesif
necessary
assessmentoffit
assessmentofDIF
itemsdisplayingDIFaresplitupif
necessary

Inprincipleeticorientedapproach.A
commonsetofinvariantitemsis
indispensable.
Conceptofpartialinvarianceallowsfor
equalitemsfunctioningdifferently.
Emicitems,i.e.itemsconfinedtoone
group,canbeconsideredbuttechnical
setupcomplicatedcomparedtoRasch
analysis

Inprincipleeticorientedapproach.
Acommonsetofinvariantitemsis
indispensable.
AccountingforDIFbysplittingthe
itemallowsforequalitems
functioningdifferently.
Emicitems,i.e.itemsconfinedto
onegroup,canbeconsideredvery
easilybecausehandlingofmissing
dataisunproblematiccomparedto
CFA

Etic(external)
versusemic
(internal)

Table1inEwing,MichaelT.,ThomasSalzberger,andRudolfR.Sinkovics(2005),"AnAlternate
ApproachtoAssessingCrossCulturalMeasurementEquivalenceinAdvertisingResearch,"
JournalofAdvertising,34(1),1736.
CourtesyofRudolfSinkovics,withpermission.
Formoreinformation,
TheImpactofRaschItemDifficultyonConfirmatoryFactorAnalysis,S.V.AryadoustRasch
MeasurementTransactions,2009,23:2p.1207
Confirmatoryfactoranalysisvs.Raschapproaches:DifferencesandMeasurementImplications,
M.T.Ewing,T.Salzberger,R.R.SinkovicsRaschMeasurementTransactions,2009,23:1p.
11945
Conventionalfactoranalysisvs.Raschresidualfactoranalysis,Wright,B.D.2000,14:2p.753.
RaschAnalysisFirstorFactorAnalysisFirst?LinacreJ.M.1998,11:4p.603.
FactoranalysisandRaschanalysis,SchumackerRE,LinacreJM.1996,9:4p.470
ToomanyfactorsinFactorAnalysis?BondTG.1994,8:1p.347
ComparingfactoranalysisandRaschmeasurement,WrightBD.1994,8:1p.350
Factoranalysisvs.Raschanalysisofitems,WrightBD.5:1p.134

EwingM.T.,SalzbergerT.,SinkovicsR.R.(2009)Confirmatoryfactoranalysisvs.Rasch
approaches:DifferencesandMeasurementImplications,RaschMeasurementTransactions,2009,
23:1,11945
PleasehelpwithStandardDataset4:AndrichRatingScaleModel

http://www.rasch.org/rmt/rmt231g.htm

3/6

22/11/2016

Conrmatory factor analysis vs. Rasch approaches: Differences and Measurement Implications

search www.rasch.org

RaschPublications
RaschMeasurement
Transactions(free,
online)

RaschMeasurement
researchpapers
(free,online)

ProbabilisticModels
forSomeIntelligence
andAttainmentTests,
GeorgRasch

ApplyingtheRasch
Model3rd.Ed.,Bond
&Fox

BestTestDesign,
Wright&Stone

StatisticalAnalyses
forLanguage
Testers,RitaGreen

RaschAnalysisinthe
HumanSciences,
Boone,Stave,Yale

RatingScale
Analysis,Wright&
Masters

IntroductiontoRasch
Measurement,E.
Smith&R.Smith

IntroductiontoMany
FacetRasch
Measurement,
ThomasEckes

Invariant
Measurement:Using
RaschModelsinthe
Social,Behavioral,
andHealthSciences,
GeorgeEngelhard,
Jr.

RaschModels:
Foundations,Recent
Developments,and
Applications,Fischer
&Molenaar

JournalofApplied
Measurement

Raschmodelsfor
measurement,David
Andrich

Constructing
Measures,Mark
Wilson

inSpanish:

AnlisisdeRaschparatodos,AgustnTristn

Mediciones,PosicionamientosyDiagnsticos
Competitivos,JuanRamnOrejaRodrguez

Tobeemailedaboutnewmaterialonwww.rasch.org
pleaseenteryouremailaddresshere:
IwanttoSubscribe: &clickbelow
IwanttoUnsubscribe: &clickbelow
Click here to confirm

PleasesetyourSPAMfiltertoacceptemailsfromRasch.org
www.rasch.orgwelcomesyourcomments:
Write here:

Youremailaddress(ifyouwantustoreply):

Send to www.rasch.org

Forum

Reset

RaschMeasurementForumtodiscussanyRaschrelatedtopic

GotoTopofPage
GotoindexofallRaschMeasurementTransactions
AERAmembers:JointheRaschMeasurementSIGandreceivetheprintedversionofRMT
SomebackissuesofRMTareavailableasboundvolumes
SubscribetoJournalofAppliedMeasurement
GotoInstituteforObjectiveMeasurementHomePage.TheRaschMeasurementSIG(AERA)
thankstheInstituteforObjectiveMeasurementforinvitingthepublicationofRaschMeasurement
http://www.rasch.org/rmt/rmt231g.htm

4/6

22/11/2016

Conrmatory factor analysis vs. Rasch approaches: Differences and Measurement Implications

TransactionsontheInstitute'swebsite,www.rasch.org.
ComingRaschrelatedEvents
Dec.79,2016,
Wed.Fri.

Inpersonworkshop:IntroductoryRasch(M.Horton,RUMM),Leeds,UK,
www.leeds.ac.uk/medicine/rehabmed/psychometric

Jan.6Feb.3,
2017,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementCoreTopics(E.Smith,Winsteps),
www.statistics.com

March31,2017,Fri.

Conference:11thUKRaschDay,Warwick,UK,www.rasch.org.uk

April23,2017,
Sun.Mon.

Conference:ValidityEvidenceforMeasurementinMathematicsEducation(VM2Ed),San
Antonio,TX,Information

May26June23,
2017,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementCoreTopics(E.Smith,Winsteps),
www.statistics.com

June30July29,
2017,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementFurtherTopics(E.Smith,Winsteps),
www.statistics.com

July31Aug.3,
2017,Mon.Thurs.

JointIMEKOTC1TC7TC13Symposium2017:MeasurementSciencechallengesinNaturaland
SocialSciences,RiodeJaneiro,Brazil,imekotc7rio.org.br

Aug.11Sept.8,
2017,Fri.Fri.

Onlineworkshop:ManyFacetRaschMeasurement(E.Smith,Facets),www.statistics.com

Aug.1821,2017,
Fri.Mon.

IACAT2017:InternationalAssociationforComputerizedAdaptiveTesting,Niigata,Japan,
iacat.org

Oct.13Nov.10,
2017,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementCoreTopics(E.Smith,Winsteps),
www.statistics.com

Jan.5Feb.2,
2018,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementCoreTopics(E.Smith,Winsteps),
www.statistics.com

Jan.1016,2018,
Wed.Tues.

Inpersonworkshop:AdvancedCourseinRaschMeasurementTheoryandtheapplicationof
RUMM2030,Perth,Australia(D.Andrich),Announcement

Jan.1719,2018,
Wed.Fri.

RaschConference:MatildaBayClub,Perth,Australia,Website

May25June22,
2018,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementCoreTopics(E.Smith,Winsteps),
www.statistics.com

June29July27,
2018,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementFurtherTopics(E.Smith,Winsteps),
www.statistics.com

Aug.10Sept.7,
2018,Fri.Fri.

Onlineworkshop:ManyFacetRaschMeasurement(E.Smith,Facets),www.statistics.com

Oct.12Nov.9,
2018,Fri.Fri.

Onlineworkshop:PracticalRaschMeasurementCoreTopics(E.Smith,Winsteps),
www.statistics.com
TheHTMLtoadd"ComingRaschrelatedEvents"toyourwebpageis:
<scripttype="text/javascript"src="http://www.rasch.org/events.txt"></script>

TheURLofthispageiswww.rasch.org/rmt/rmt231g.htm
http://www.rasch.org/rmt/rmt231g.htm

5/6

22/11/2016

Conrmatory factor analysis vs. Rasch approaches: Differences and Measurement Implications

Website:www.rasch.org/rmt/contents.htm

http://www.rasch.org/rmt/rmt231g.htm

6/6