MAAL 6014 LANGUAGE TESTING AND EVALUATION COURSE OUTLINE 2011-2012

Lecturer Mr. Phil Smyth Introduction The aims of this elective course are to: a) introduce participants to the fundamental principles of language testing and language test evaluation b) develop skills in the design, trialling, moderation and validation of testing instruments for a range of purposes including: formative and summative assessment, self-assessment, language profiling

Intended Learning Outcomes (ILOs) At the end of the course you should be able to:

i. ii. iii. iv.

v.

describe and discuss a range of contexts, purposes and methods for language testing discuss and critique the appropriacy and usefulness of various methods for testing writing, speaking, listening, reading and integrated skills plan and organize the test development process, specification of test tasks and procedures analyze, describe and report data derived from test scores using a range of techniques including item analysis, estimation of reliability, investigation of validity and potential test bias describe and discuss appropriate techniques for the evaluation of language tests

Core text Hughes, A. (2003). Testing for language teachers 2nd Edition. Cambridge: Cambridge University Press

Sources of additional readings and bibliographic references Alderson, J.C., Clapham, C. & Wall, D. (1995). Language test construction and evaluation. Cambridge. Cambridge University Press

Bachman, L.F. (1990). Fundamental Considerations in Language Testing. Oxford: Oxford University Press Bachman, L.F. & Palmer, A.S. (1996). Language testing in practice: designing and developing useful language tests. Oxford. Oxford University Press

Berry, V. and Lewkowicz, J. (2000). Assessment in Chinese Contexts: Special Issue of the Hong Kong Journal of Applied Linguistics. The English Centre, The University of Hong Kong

Fulcher, G. and Davidson, F. (2007). Language Testing and Assessment. Abingdon: Routledge

McNamara, T. (1996). Measuring Second Language Performance. Harlow: Pearson Education Limited McNamara, T. (2000). Language Testing. Oxford: Oxford University Press Weir, C.J. (2005). Language Testing and Validation. Basingstoke: Palgrave Macmillan

Web-based resources:
http://languagetesting.info/ is a one-stop site for references on testing specific language skills and using statistics. There are also short video clips of topics in language testing. It is maintained by Dr. Glenn Fulcher.

Course Outline:
Session 1: Theoretical influences in language testing Session 2: Test specifications and test tasks Session 3: Item writing, moderation, scoring and reporting Session 4: Performance assessment Session 5: Reliability, validity and item analysis Session 6: Classroom-based assessment and Alternative assessment

Assessment (2500 words)

All participants will be expected to complete an assignment in an area of language testing to be agreed with the course tutor. Two questions are given below. 1. Design, trial and evaluate a language test for a group of students of your choice. You should include a rationale for the test development process (specification of learners, learning situation, type of test - summative, formative, placement, etc.). After administration and scoring you should be able to provide descriptive statistics regarding the reliability of the test and an item analysis where appropriate. 2. To what extent do you agree with the statement: Theres no such thing as a perfect test? Illustrate your response with reference to current theory relating to test development and validation procedures. Give examples from an educational context with which you are familiar wherever possible.