Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Peter Noakes
Department of Electronic Systems Engineering University of Essex
Structure of Talk
Background
Learning Outcomes Level Descriptors (QAA, SEEC, EPC)
Assessment Methods
Assessment Criteria An Example for You
Reference Sources
This presentation is based on the content of the following publications: How to use Level Descriptors by Jenny Moon, SEEC*, 2002 How to Use Learning Outcomes and Assessment Criteria by David Gosling and Jenny Moon, SEEC*, 3rd Edition 2002 Assessment: A Guide for Lecturers by George Brown, LTSN Generic Centre, 2001 Guide for Busy Academics, LTSN Generic Centre
Background
A Programme defines study or learning required to achieve an award or qualification
A Programme Specification is required by the QAA for each award or qualification and defines the threshold learning outcomes for the programme
A Programme comprises a number of Modules each of which is separately assessed and earns credit when successfully completed Using the outcomes model each Module Description defines the intended (threshold?) learning outcomes, the syllabus coverage and the assessment methods and criteria for the module.
Achievement of Module Learning Outcome should contribute to a students satisfaction of the programme learning outcomes
LTSN Workshop at University of Essex 26th June 2003
5
2.
3.
SEEC defines Level Descriptors as Level Zero, Level 1, Level 2, Level 3 and Masters Level. These broadly correspond to preliminary Year, Years 1, 2, 3 and first year postgraduate level respectively
LTSN Workshop at University of Essex 26th June 2003
7
Level Descriptors?
Think of Level Descriptors as a means of communication about expectations of students study They are not rigid but developmental Student Learning is commonly described in terms of :
complexity of knowledge and understanding standard of cognitive skills
key or transferable skills achieved the expected responsibility of the learner the autonomy or independence of the learner amount of guidance required by the learner
Be careful of differences in the implied standard of learning! Is it defined for a threshold student, an average (or typical!) student or the best student?
LTSN Workshop at University of Essex 26th June 2003
8
5 4
Synthesis Analysis
Application
2 1
Manipulation Knowledge
HE Level 2
The Learner has a detailed knowledge of major theories of the discipline and an awareness of a variety of ideas, contexts and frameworks The Learner is aware of the wider social and environmental implications of area of study and is able to debate issues in relation to more general perspectives
LTSN Workshop at University of Essex 26th June 2003
HE Level 3
The Learner has a comprehensive / detailed knowledge of a major discipline with areas of specialisation in depth and awareness of the provisional nature of knowledge The Learner is aware of personal responsibility and professional codes of conduct and can incorporate a critical ethical dimension into a major piece of work
13
The Learner can demonstrate awareness of ethical issues in current areas of study and is able to discuss these in relation to personal beliefs and values
Ethical Issues
HE Level 2
The Learner can analyse a range of information with minimum guidance using given classifications / principles and can compare alternative methods and techniques for obtaining data The Learner can reformat a range of ideas and information towards a given purpose
HE Level 3
The Learner can analyse new and / or abstract data and situations without guidance, using a range of techniques appropriate to the subject
Analysis
Synthesis
The Learner can collect and categorise ideas and information in a predictable and standard format
The Learner with minimum guidance can transform abstract data and concepts towards a given purpose and can design novel solutions
14
HE Level 2
The Learner can select appropriate techniques of evaluation and can evaluate the relevance and significance of the data collected The Learner can identify key elements of problems and choose appropriate methods for their resolution in a considered manner
LTSN Workshop at University of Essex 26th June 2003
HE Level 3
The Learner can critically evaluate evidence to support conclusions / recommendations, reviewing its reliability validity and significance. Can investigate contradictory information / identify reasons for contradictions The Learner is confident and flexible in identifying and defining complex problems and can apply appropriate knowledge and skills to their solution
15
The Learner can apply given tools / methods accurately and carefully to a well defined problem and begin to appreciate the complexity of the issues
Application
HE Level 2
The Learner can interact effectively with a team / learning group, giving and receiving information and ideas and modifying response where appropriate.
HE Level 3
The Learner can interact effectively with a team / learning group / professional group, recognise, support or be proactive in leadership, negotiate in a professional context and manage conflict. The Learner with minimum guidance can manage own learning using a full range of resources for the discipline. Can work professionally within the discipline.
16
Group Working
The Learner can work within an appropriate ethos and can use and access a range of learning resources.
The Learner can manage learning using resources for the discipline. Can develop working relationships of a professional nature within the discipline.
LTSN Workshop at University of Essex 26th June 2003
Learning Resources
HE Level 2
The Learner can evaluate own strengths and weakness, challenge received opinion and develop own criteria and judgement. The Learner can manage information. Can select appropriate data from a range of sources and develop appropriate research strategies.
LTSN Workshop at University of Essex 26th June 2003
HE Level 3
The Learner is confident in application of own criteria of judgement and can challenge received opinion and reflect on action. Can seek and make use of feedback. The Learner can select and manage information, competently undertake reasonably straightforward research tasks with minimum guidance
17
The Learner can manage information, collect appropriate data from a range of sources and undertake simple research tasks with external guidance.
Information Mangement
HE Level 2
The Learner can take responsibility for own learning with minimum direction. The Learner can communicate effectively in a manner appropriate to the discipline and report practical procedures in a clear and concise manner in a variety of formats.
LTSN Workshop at University of Essex 26th June 2003
HE Level 3
The Learner can take responsibility for own work and can criticise it.
Communications
The Learner can engage effectively in debate in a professional manner and produce detailed and coherent project reports
18
HE Level 1
The Learner can apply given tools / methods accurately and carefully to a well defined problem and begin to appreciate the complexity of the issues in the discipline.
HE Level 2
The Learner can identify key areas of problems and choose appropriate tools / methods for their resolution in a considered manner.
HE Level 3
The Learner is confident and flexible in identifying and defining complex problems and the application of appropriate knowledge, tools / methods to their solution.
Problem Solving
19
HE Level 2
The Learner can operate in situations of varying complexity and predictability requiring application of a wide range of techniques. The Learner is able to act with increasing autonomy, with reduced need for supervision and direction, within defined guidelines.
LTSN Workshop at University of Essex 26th June 2003
HE Level 3
The Learner can operate in complex and unpredictable contexts, requiring selection and application from a wide range of innovative or standard techniques. The Learner is able to act autonomously, with minimal supervision or direction, within agreed guidelines.
Application of Skills
20
6. Ability to apply the results from physical models to create real target systems.
This means the ability to: a) Write sufficiently detailed specifications of real target systems, including risk assessments and impact statements. b) Select production methods and write method statements. c) Implement production and deliver products fit for purpose, in a timely and efficient manner. d) Operate within relevant legislative frameworks.
24
Develop a teaching strategy to enable learners to reach the learning outcomes / assessment criteria
LTSN Workshop at University of Essex 26th June 2003
25
26
Develop the module and rethink it including the initial learning outcomes
Modify current teaching strategy to enable learners to reach the learning outcomes / assessment criteria
LTSN Workshop at University of Essex 26th June 2003
27
A verb that indicates what the learner is expected to be able to do at the end of the period of learning
Word(s) that indicate on what or with what the learner is acting. If the outcome is about a skill then the word may describe the way the skill is performed Word(s) that indicate the nature (in context or terms of standard) of the performance required as evidence that the learning was achieved
LTSN Workshop at University of Essex 26th June 2003
28
explain the physical basis of the operation of Metal Oxide Semiconductor Transistors (MOSFETs) and obtain the small signal model of a MOSFET (Level 2 Electronic Devices)
LTSN Workshop at University of Essex 26th June 2003
29
Purposes of Assessment
To provide a licence to proceed to the next stage of the programme or to graduation To classify the performance of the student in rank order To improve student learning by providing feedback on his or her strengths and weaknesses To motivate the student to learn To provide information for future selection or as a licence to practice To evaluate the course and improve teaching These may overlap or conflict!
A common error is to assume that the results of an assessment task used for one purpose are appropriate for another purpose
LTSN Workshop at University of Essex 26th June 2003
34
Match the assessment tasks to the learning outcomes Match the assessment criteria to the task and the learning outcomes Keep the assessment criteria simple Be fair, reliable and valid in your marking Provide meaningful and timely feedback Do we apply these principles?
LTSN Workshop at University of Essex 26th June 2003
35
Progress tests
Projects
Requirement Analysis, Research, Problem Solving / Synthesis Practical Development Oral and Written Communication Possibly Group Working
LTSN Workshop at University of Essex 26th June 2003
36
Absence of well defined criteria so consistency is difficult to achieve Unduly specific criteria which create a straightjacket for students Inadequate or superficial feedback provided to students Wide variation in marking between modules and within assessors Variation in assessment demands of different modules
LTSN Workshop at University of Essex 26th June 2003
37
Designing Assessments
Some questions to be considered
What are the learning outcomes to be assessed? What are the capabilities / skills either implicit of explicit, within the learning outcomes? Is the method of assessment chosen appropriate to the outcomes and skills? Is the method relatively efficient in terms of student time and staff time? What alternatives are there and what are their advantages and disadvantages? Does the specific assessment task match the outcomes and skills? Are the marking schemes or criteria appropriate?
LTSN Workshop at University of Essex 26th June 2003
38
5.
6. 7. 8.
An Example
The learner is expected to be able to:
demonstrate understanding of the purpose and operation of the hardware and software components present in personal computers, microprocessors and embedded processor applications. (Level 1 Computer Systems)
Assessment Task?
Hardware Laboratory: Test and evaluate the operation of computer hardware components by constructing a serial adder on a logic patch-board using available TTL devices.
Assessment Criteria:
Connect correctly the following functional elements on the patchboard provided: EX-OR, Half Adder, Full Adder, 4 to1 Multiplexer, D-type bistable carry store, 4-bit register, 4-bit counter, and links modules to form a 4-bit serial adder. Test each module and record results Complete the multi-choice test and score better than 70%
LTSN Workshop at University of Essex 26th June 2003
41
Form Groups of 3 or 4
1. Write a Threshold Learning Outcome for this module 2. Develop an Assessment Task to address this learning outcome 3. Write Assessment Criteria for this task
43
The objective is to develop module specifications and structures where the threshold and extended learning outcomes, and associated assessment methods and criteria are clearly defined for students.
As a result a students satisfaction of threshold learning outcomes should be readily determined Initially concentrating of Year 1 Modules offered by ESE
Project Proposals
In future a module description will identify separately the threshold and extended (desirable) learning outcomes and syllabus
The threshold syllabus defines the topics and associated skills, their method of assessment and associated assessment criteria, that will be used to demonstrate threshold level achievement for the module
The extended syllabus defines the topics, their method of assessment and associated assessment criteria, that will be used to demonstrate understanding and application of their knowledge above the threshold level for the module allowing grading above Third class. The threshold aspects of the module will be taught conventionally with clear guidance to required reading, and supported by regular formative on-line MCQ testing The extended aspects of the module will be taught by a combination of special topic lectures and directed self study with associated supporting problem classes LTSN Workshop at University of Essex 48
26th June 2003
Module Specifications
Module specifications to be captured by filling form to provide entry to a central database Data to be extracted for various audiences by running different reports
49
Module mark generated by forming a weighted aggregate of the marks awarded to individual elements
A 40% overall aggregate does not ensure that all learning threshold outcomes have been satisfied!
LTSN Workshop at University of Essex 26th June 2003
50
Graphical Representation
Module Marks
100 90 80 70 60 Part B examination
50
40 30
20
10
Threshold Assessments