University Press Scholarship Online

You are looking at 1-10 of 11 items for: keywords : test theory

Health Measurement Scales : A practical guide to their development and use

David L. Streiner, Geoffrey R. Norman
Published in print: 2008 Published Online: Publisher: Oxford University Press September 2009 DOI: 10.1093/ ISBN: 9780199231881 eISBN: 9780191724015 acprof:oso/9780199231881.001.0001 Item type: book

This book covers in detail how to develop a measurement scale: a questionnaire or instrument, with specific applications in health sciences. Its organization follows the steps developers will go through during the process beginning with how the individual items are developed, and the various biases that can affect responses (e.g., social desirability, yeasaying, framing). It then discusses different response options, such as Likert scales, adjectival scales, visual analogue scales, Harter scales, and face scales, and the advantages and disadvantages of each. The book then explains how to select the best items in the set, using various psychometric criteria; and how to combine the individual items into a scale. There is much discussion of reliability and validity, from both a theoretical and statistical perspective, with a separate chapter on generalizability theory. Although the perspective is that of classical test theory, there is also an in-depth presentation of item response theory. It concludes with a discussion of ethical issues that may be encountered in developing and using scales; and presents guidelines for reporting the results of the scale development process. In the appendices there is a comprehensive guide to finding existing scales, and a brief introduction to exploratory and confirmatory factor analysis.

Conclusion

Kevin A. Clarke, David M. Primo in A Model Discipline: Political Science and the Logic of Representations
Published in print: 2012 Published Online: May Publisher: Oxford University Press 2012 DOI: 10.1093/ ISBN: 9780195382198 eISBN: 9780199932399 acprof:oso/9780195382198.003.0007 Item type: chapter

Page 1 of 6

This chapter summarizes the two central arguments of this book. First, testing theoretical models is not logically possible. Second, testing theoretical models is unnecessary and mistakes the true nature of models. We then address eight issues that our argument raises: (1) Talking about these issues is a distraction from getting on with our work. (2) I believe your arguments, but I will be criticized for adopting them. (3) You make an analogy between models and maps, but maps are tested! (4) Your approach to model evaluation is not precise. (5) Perhaps proponents of EITM cannot show evidence of progress, but neither can you. (6) What about verbal or computational models? (7) What should a political scientist do differently when he or she sits down at the computer to work? (8) Where do we go from here?

Testing
Qin Duo in The Formation of Econometrics: A Historical Perspective
Published in print: 1997 Published Online: Publisher: Oxford University Press November 2003 DOI: 10.1093/0198292872.003.0006 ISBN: 9780198292876 eISBN: 9780191596803 Item type: chapter

Addresses the issue of testing, and reveals some intrinsic problems pertaining to hypothesis testing beneath the achievements of formalizing econometrics. Theory verification through applied studies forms one of the main motives for formalizing methods of model estimation and identification, and the statistical theory of hypothesis testing was accepted without much dispute quite early as the technical vehicle to fulfil this desire. However, during the adoption of the theory into econometrics in the 1940s and 1950s, the achievable domain of verification turned out to be considerably reduced, as testing in econometrics proper gradually dwindled into part of the modelling procedure and pertained to model evaluation using statistical testing tools; in the applied field, empirical modellers took on the task of discriminating between and verifying economic theories against the model results, and carried this out in an ad hoc and often nonsequitur manner. Describes how the desire to test diverged into model evaluation in econometric theory on the one hand, and economic theory verification in practice on the other, as econometric testing theory took shape. The story begins with the early period prior to the formative movement in the first section of the chapter; the following section looks at the period in which the theme of hypothesis testing was introduced, and the first test emerged in econometrics; the last two sections report, respectively, on how model testing in applied econometrics and test design in theoretical econometrics developed and moved apart.
Page 2 of 6

Reliability

Neil Abell, David W. Springer, Akihito Kamata in Developing and Validating Rapid Assessment Instruments
Published in print: 2009 Published Online: Publisher: Oxford University Press September 2009 DOI: 10.1093/ ISBN: 9780195333367 eISBN: 9780199864300 acprof:oso/9780195333367.003.0004 Item type: chapter

This chapter provides a theoretical overview of reliability, as well as pragmatic considerations in establishing different types of reliability. To illustrate key points, it draws from two scales: the Family Responsibility Scale and the Parental Self-Care Scale. Various forms of reliability are addressed, including interrater, test-retest, and internal consistency. Guidelines for interpreting reliability coefficients for clinical and research purposes are provided, including computation of stratified alpha for multidimensional measures. Computation of the standard error of measurement (SEM) is illustrated. The chapter concludes by asserting that a solid reliability coefficient is indispensable as a primary principle in assessing the quality of scores from a scale or test.

The methodological and statistical foundations of neuropsychological assessment

Klaus Willmes in The Handbook of Clinical Neuropsychology
Published in print: 2010 Published Online: Publisher: Oxford University Press September 2010 DOI: 10.1093/ ISBN: 9780199234110 eISBN: 9780191594250 acprof:oso/9780199234110.003.03 Item type: chapter

This chapter begins with a discussion of psychometric aspects of neuropsychological tests. It then discusses the classical test theory model, criterion-referenced testing, probabilistic test models, individual case classification, psychometric single-case analysis, and comparison of a single case to a small control or normative sample.

Introduction

J. Patrick Meyer in Understanding Measurement: Reliability

Published in print: 2010 Published Online: Publisher: Oxford University Press March 2012 DOI: 10.1093/ ISBN: 9780195380361 eISBN: 9780199847914 acprof:oso/9780195380361.003.0001 Item type: chapter

Page 3 of 6

Unobservable characters called constructs or latent traits are frequently measured by social scientists though certain educational and psychological tests. It is observed in this chapter that measuring the observable characteristics is not as deterministic as measuring physical characteristics and that measurement error exists. In this first chapter, general concepts are presented. Reliability is defined as the extent to which test scores are consistent with another set of test scores produced from a similar process. The measurement procedure includes all aspects of testing the situation. Sampling can be done by the sampling of one or more aspects of the measurement procedure or the sampling of examinees. The classical test theory and the generalizability theory are also presented. Concepts under reliability are discussed in more detail in the succeeding chapters.

Discussion and Recommended Readings

J. Patrick Meyer in Understanding Measurement: Reliability
Published in print: 2010 Published Online: Publisher: Oxford University Press March 2012 DOI: 10.1093/ ISBN: 9780195380361 eISBN: 9780199847914 acprof:oso/9780195380361.003.0006 Item type: chapter

Absolutely no judgment or evaluation should be included when reporting a reliability analysis. Estimates should speak for themselves and it is the task of the readers to judge their values. The discussion should focus on limitations of analysis. In this chapter, example discussions for the Benchmark Assessment of English Language Arts (ELA), the Palmetto Achievement Challenge Test (PACT) of mathematics, and the MSCAN are provided. Several books for future reading are recommended. These include books on classical test theory. Some of the recommended book include Theory of Mental Tests by Gulliksen, Statistical Theories of Mental Test Scores by Lord and Novick, and Reliability for the Social Sciences: Theory and Applications by Traub. The chapter also advises that reading be done on original references so that one can read the original words of the author. Other references are given after this chapter.

Introduction

Christine DeMars in Item Response Theory

Published in print: 2010 Published Online: Publisher: Oxford University Press March 2012 DOI: 10.1093/ ISBN: 9780195377033 eISBN: 9780199847341 acprof:oso/9780195377033.003.0001 Item type: chapter Page 4 of 6

Item response theory (IRT) models show the relationship between the ability or trait () measured by the instrument and an item response. Both the IRT and classical test theory (CTT) indices and how they are related in terms of item parameters, conceptualization of reliability and standard error of measurement, and population invariance are described. The IRT indices are more readily understood in the context of the formal mathematical models for describing the item response probabilities, in which these models are discussed. The IRT indices are introduced only in general terms. The three-parameter logistic (3PL), two-parameter logistic (2PL), and one-parameter logistic (1PL) dichotomous models are presented, along with the Graded Response (GR) and Generalized Partial Credit (GPC) polytomous models.

Applying the I-Space

Max H. Boisot in Knowledge Assets: Securing Competitive Advantage in the Information Economy
Published in print: 1999 Published Online: Publisher: Oxford University Press October 2011 DOI: 10.1093/ ISBN: 9780198296072 eISBN: 9780191685194 acprof:oso/9780198296072.003.0010 Item type: chapter

I-Space is a conceptual framework built on a theory of information flows. Any theory worth its salt should be tested in encounters with concrete experience. Some of these encounters are explicitly designed to test the theory. Assessment of what the I-Space contributed in some interventions described in this chapter offers three detailed benefits: it permitted a diagnosis, it promoted constructive debate and generated numerous insights, and it pointed to specific issues that needed dealing with. The interventions also specified how the I-Space, as a conceptual framework, could be further developed and applied. An effective use of the framework requires skilful interpretation of the data.

Understanding Measurement: Reliability

Patrick Meyer
Published in print: 2010 Published Online: Publisher: Oxford University Press March 2012 DOI: 10.1093/ ISBN: 9780195380361 eISBN: 9780199847914 acprof:oso/9780195380361.001.0001 Item type: book

This is a book in the Understanding Statistics series, which is designed to provide guides to understanding, presenting, and critiquing analyses and associated inferences. Each book in the series demonstrates how the relevant topic should be reportedincluding detail surrounding what
Page 5 of 6

can be said, and how it should be said, as well as drawing boundaries around what cannot appropriately be claimed or inferred. This volume addresses reliability, which is a fundamental aspect of any social science study that involves educational or psychological measurement. It not only has implications for the quality of test scores themselves, but also any statistical analysis conducted using those scores. Topics addressed in this book cover three different types of reliability methods and appropriate standard errors of measurement: classical test theory methods, decision consistency indices, and generalizability theory coefficients. After a brief introduction to the topic, the book outlines how to report reliability in professional journal articles. It includes examples of both good and bad write-ups for methods sections of journal articles.

Page 6 of 6