Sei sulla pagina 1di 19

https://www.facebook.com/groups/AIOU.

EducationForAll

COURSE: Educational Measurement and Evaluation (6507)


ASSIGNMENT NO 1

QNO1: Explain the principles of classroom assessment by providing examples. Also

differentiate between formative and summative assessment in the light of their importance

L
in teaching learning process.

ha
ANS: Assessment is a systematic process of gathering information about what a student knows,

is able to do, and is learning to do. Assessment information provides the foundation for decision-

making and planning for instruction and learning. Assessment is an integral part of instruction

ug
that enhances, empowers, and celebrates student learning. Using a variety of assessment

techniques, teachers gather information about what students know and are able to do, and

provide positive, supportive feedback to students. They also use this information to diagnose

individual needs and to improve their instructional programs, which in turn helps students learn
M
more effectively. Assessment must be considered during the planning stage of instruction when

learning outcomes and teaching methods are being targeted. It is a continuous activity, not

something to be dealt with only at the end of a unit of study. Students should be made aware of
i

the expected outcomes of the course and the procedures to be used in assessing performance
dh

relative to the learning outcomes. Students can gradually become more actively involved in the

assessment process in order to develop lifelong learning skills. Evaluation refers to the decision

making which follows assessment. Evaluation is a judgment regarding the quality, value, or

worth of a response, product, or performance based on established criteria and curriculum


E

standards. Evaluation should reflect the intended learning outcomes of the curriculum and be

consistent with the approach used to teach the language in the classroom. But it should also be

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

sensitive to differences in culture, gender, and socio-economic background. Students should be

given opportunities to demonstrate the full extent of their knowledge, skills, and abilities.

Evaluation is also used for reporting progress to parents or guardians, and for making decisions

related to such things as student promotion and awards Diagnostic assessment may occur at the

L
beginning of a term or a unit of study, or whenever information about the prior learning of a

student is useful. Various types of diagnostic assessments (tests, journals, performance-based

ha
assessment, etc.) may be used to collect that information. Teachers may use diagnostic

assessment to ! find out what students know and can do ! identify student strengths and plan

instruction which builds on and extends those strengths ! target difficulties, identify the precise

ug
nature of them, and plan instruction to meet those difficulties ! make informed decisions

regarding where to focus instructional time and effort Formative assessment is similar to

diagnostic assessment but differs in that it provides ongoing feedback to the teacher about the

effectiveness of instruction. Formative assessment encompasses a variety of strategies, used


M
selectively to accomplish one or more of the following purposes: ! monitor student learning and

provide feedback to students and parents ! identify areas of growth ! motivate students and

provide incentive to study ! help focus attention and effort ! emphasize what is important to learn
i

! provide practice in applying, demonstrating, and extending knowledge, skills, and attitudes !
dh

encourage goal-setting and monitor achievement of goals ! reflect on program structure and

effectiveness, and modify or adjust teaching as necessary Summative assessment occurs most

often at the end of a unit of study. The primary purposes are to determine the knowledge, skills,

and attitudes that have developed over a period of time, to summarize student progress.
E

Summative assessment, however, is used to evaluate student’s learning at the end of an

instructional unit by comparing it against some standard or benchmark.


2

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

You can tell from their definitions that those two evaluation strategies are not meant to evaluate

in the same way. So let’s take a look at the biggest differences between them.

QNO2: Elaborate the concept of Reliability of a test, also explain different measure to

L
enhance the reliability of a test.

ANS: Test reliablility refers to the degree to which a test is consistent and stable in

ha
measuring what it is intended to measure. Most simply put, a test is reliable if it is

consistent within itself and across time. To understand the basics of test reliability,

think of a bathroom scale that gave you drastically different readings every time you

ug
stepped on it regardless of whether your had gained or lost weight. If such a scale

existed, it would be considered not reliable. Whenever a person takes a test, several factors

influence the test taker’s score. The most important factor (and usually the one with the greatest
M
influence) is the extent to which the test taker has the knowledge and skills that the test is

supposed to measure. But the test taker’s score will often depend to some extent on other kinds

of knowledge and skills, that the test is not supposed to measure. Reading ability and writing
i

ability often influence students’ scores on tests that are not intended to measure those abilities.
dh

Another influence is the collection of skills we call “testwiseness.” One such skill is using testing

time efficiently. Another is knowing when and how to guess on a multiple-choice test. A kind of

test-wiseness that is often useful on an essay test is knowing how to include relevant knowledge

you have, for which the question does not specifically ask. One factor that can influence a test
E

score is the test taker’s alertness and concentration on the day of the test. In test taking, as in

many other activities, most people perform better on some days than on others. If you take a test

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

on a day when you are alert and able to concentrate, your score is likely to be higher than it

would be if you took it on a day when you were drowsy or distracted. On most tests, the

questions or problems that the test taker is confronted with are not the only ones that could have

been included. Different editions of the test include different questions or problems intended to

L
measure the same kinds of knowledge or skill. At some point in your education, you have

probably been lucky enough to take a test that just happened to ask about the things you knew.

ha
And you have probably had the frustrating experience of taking a test that happened to include

questions about several specific things you did not know. Very few test takers (if any) would

perform equally well on any set of questions that the test could include. A test taker who is

ug
strong in the abilities the test is measuring will perform well on any edition of the test—but not

equally well on every edition of the test. When a classroom teacher gives the students an essay

test, typically there is only one rater—the teacher. That rater usually is the only user of the scores

and is not concerned about whether the ratings would be consistent with those of another rater.
M
But when an essay test is part of a large-scale testing program, the test takers’ essays will not all

be scored by the same rater. Raters in those programs are trained to apply a single set of criteria

and standards in rating the essays. Still, a test taker’s essay might be scored by a rater who
i

especially likes that test taker’s writing style or approach to that particular question. Or it might
dh

be scored by a rater who particularly dislikes the test taker’s style or approach. In either case, the

rater’s reaction is likely to influence the rating. Therefore, a test taker’s score can depend on

which raters happened to score that test taker’s essays. This factor affects any test that is scored

by a process that involves judgment. We cannot do much to reduce the effect of day-to-day
E

differences in a test taker’s concentration and alertness (beyond advising test takers not to be

tired or hungry on the day of the test). We could reduce the effect of these differences if we
4

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

could give the test in several parts, each part on a different day, but such a testing procedure

would not be practical for most tests. On most tests that have important consequences for the test

taker, test takers who think their performance was unusually weak can retake the test, usually

after waiting a specified time. There are some things we can do to reduce the effect of the

L
specific selection of questions or problems presented to the test taker. We can create detailed

specifications for the content and format of the test questions or problems, so that the questions

ha
on different forms will measure the same set of knowledge and skills. We can avoid reporting

scores based on only a few multiplechoice questions or problems. And we can adjust the scores

to compensate for differences in the overall difficulty of the questions on different editions of the

ug
test.1 But we cannot make the different editions of a test equally difficult for each individual test

taker. There are also some things we can do to reduce the effect of the specific selection of raters

who score a test taker’s essays, performance samples, or other responses. We can create explicit

scoring instructions, so that all the raters will use the same criteria. We can train the raters
M
thoroughly, with carefully chosen examples of responses to score, so that all the raters will use

the same standards in deciding what rating to award. We can test the raters by having them rate

essays that have previously been rated by expert raters, and we can require a certain level of
i

accuracy before we allow them to rate operationally. We can monitor the raters’ performance,
dh

comparing ratings they award with ratings awarded to the same responses by expert raters. We

can provide additional training for raters whose ratings do not agree closely with the experts’

ratings, and we can replace those raters for whom the retraining is not successful. But we cannot

get all raters to agree about the appropriate rating for every response. For some kinds of tests, we
E

can get close to this ideal of perfect agreement, but for others, we cannot.

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

QNO3: Write down important characteristics of educational objectives. Also describe the

SOLO taxonomy of educational objectives and its role in test development.

ANS: The term learning means changes in our behavior, attitude, knowledge and skills. In other

L
wards we can say that through learning we can feel permanently changes in our self. If we are

not feeling any changes in our above skills then it will not be called as learning. The learning is a

ha
type of reinforcement, which may learn a change in behavior enduring by strengthening and

intensifying certain aspect of an individual behavior

1. Audience- Audience is the target of learning objective and the audience character.

ug
2. Behavior - Behavior is expected from the learner to show the audience has learn something

from the instructor.

3. Condition-Under what condition will the learner be expected to demonstrate his/her


M
knowledge. It is the responsibility of instructor to create an atmosphere of learning for grasping

the memory from the learning environment.

Main characteristics Educational objective


i
dh

1. The learning objective should identify a learning outcomes – The main objective of learning is

reflection. The objective needs to state what the learner is to perform, not how the learn lesson.

2. The learning objective should be consistent with course goal – it is necessary that the learning
E

objective should be consistent with the course goal. When objective and goals are not consistent

two avenues of approached will be available.

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

- Change the objective or

- Change the course goal

3. The learning objective should be precious:- Its some have difficulties to strike a balance

L
between too much and too little precious in an objective. There should be a free line between

choosing objective that reflects an important and meaningful outcome of instructions and

ha
objective. To make the objective of learning the affective steps are as under:

- Starts class on schedule.

ug
- Present material listed in lesson plans and follows the general outline.

- Use following traits and techniques while conducting instruction: flexibility, spontaneity,

provides empathy, and compassion uses good questioning techniques, is an active listener, gets
M
feedback, uses positive reinforcement, and provide counseling.

Learning Objective and Techniques of Motivation

Knowledge, Understanding, application and creativity can be used as criteria for selecting the
i
dh

appropriate techniques of motivation.

1) Knowledge Objectives: This objective is achieved to develop the recall and recognition

abilities .it is the lowest learning objective and concerns with the environment of objects. The
E

reward, praise, punishment and reproof techniques of motivation may be employed to achieve

knowledge objective. The concrete form of motivation is effective for this purpose.

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

2) Understanding objectives: The understanding objective is realized by developing the

abilities of seeing relationship, discrimination, cite example and generalization, the environment

and content both are equally important for providing appropriate learning experiences to the

students. The praise, success, punishment and failure techniques of motivation can assist in

L
achieving this objective.

ha
3) Application objectives: An application objective is achieved by developing the abilities of

reasoning, hypothesizing, inferring, and prediction. The perception and expectancies of the

students play the significant role. The success and failure, cooperation and competition

knowledge of results and attitude, techniques of motivation can help in realizing the objective of

application ug
QNO4: Elaborate the different techniques for the measurement of attitude of the learners

by providing examples. Discuss the importance of measurement of attitude of learner in


M
teaching learning process.

ANS: Perhaps the most straightforward way of finding out about someone’s attitudes would be

to ask them. However, attitudes are related to self-image and social acceptance.
i
dh

In order to preserve a positive self-image, people’s responses may be affected by social

desirability. They may not well tell about their true attitudes, but answer in a way that they feel

socially acceptable.
E

Given this problem, various methods of measuring attitudes have been developed. However, all

of them have limitations. In particular the different measures focus on different components of

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

attitudes – cognitive, affective and behavioral – and as we know, these components do not

necessarily coincide.

Attitude measurement can be divided into two basic categories

L
Direct Measurement (likert scale and semantic differential)

ha
Indirect Measurement (projective techniques and the implicit association test)

Direct Attitude Measures

Semantic Differential

ug
The semantic differential technique of Osgood et al. (1957) asks a person to rate an issue or topic

on a standard set of bipolar adjectives (i.e. with opposite meanings), each representing a seven

point scale.
M
To prepare a semantic differential scale, you must first think of a number of words with opposite

meanings that are applicable to describing the subject of the test.


i

For example, participants are given a word, for example 'car', and presented with a variety of
dh

adjectives to describe it. Respondents tick to indicate how they feel about what is being

measured.

In the picture (above), you can find Osgood's map of people's ratings for the word 'polite'. The
E

image shows ten of the scales used by Osgood. The image maps the average responses of two

groups of 20 people to the word 'polite'.

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

The semantic differential technique reveals information on three basic dimensions of attitudes:

evaluation, potency (i.e. strength) and activity.

• Evaluation is concerned with whether a person thinks positively or negatively about the

attitude topic (e.g. dirty – clean, and ugly - beautiful).

L
• Potency is concerned with how powerful the topic is for the person (e.g. cruel – kind, and

ha
strong - weak).

• Activity is concerned with whether the topic is seen as active or passive (e.g. active –

passive).
ug
Using this information we can see if a persons feeling (evaluation) towards an object is

consistent with their behavior. For example, a place might like the taste of chocolate
M
(evaluative) but not eat it often (activity).

The evaluation dimension has been most used by social psychologists as a measure of a person’s

attitude, because this dimension reflects the affective aspect of an attitude.


i
dh

Evaluation of Direct Methods

An attitude scale is designed to provide a valid, or accurate, measure of an individual’s social


E

attitude. However, as anyone who has every “faked” an attitude scales knows there are

shortcomings in these self report scales of attitudes.

10

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

There are various problems that affect the validity of attitude scales. However, the most

common problem is that of social desirability.

Socially desirability refers to the tendency for people to give “socially desirable” to the

questionnaire items. People are often motivated to give replies that make them appear “well

L
adjusted”, unprejudiced, open minded and democratic. Self report scales that measure attitudes

ha
towards race, religion, sex etc. are heavily affected by socially desirability bias.

Respondents who harbor a negative attitude towards a particular group may not wish be admit to

the experimenter (or to themselves) that they have these feelings. Consequently, responses on

ug
attitude scales are not always 100% valid.

Draw a Person Test

Figure drawings are projective diagnostic techniques in which an individual is instructed to


M
draw a person, an object, or a situation so that cognitive, interpersonal, or psychological

functioning can be assessed. The test can be used to evaluate children and adolescents for a

variety of purposes (e.g. self-image, family relationships, cognitive ability and personality).
i
dh

A projective test is one in which a test taker responds to or provides ambiguous, abstract, or

unstructured stimuli, often in the form of pictures or drawings.

While other projective tests, such as the Rorschach Technique and Thematic Apperception
E

Test, ask the test taker to interpret existing pictures, figure drawing tests require the test taker to

create the pictures themselves. In most cases, figure drawing tests are given to children. This is

because it is a simple, manageable task that children can relate to and enjoy.
11

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

Evaluation of Indirect Methods

The major criticism of indirect methods is their lack of objectivity. Such methods are unscientific

and do not objectively measure attitudes in the same way as a Likert scale.

L
There is also the ethical problem of deception as often the person does not know that their

attitude is actually being studied when using indirect methods.

ha
The advantages of such indirect techniques of attitude measurement are that they are less likely

to produce socially desirable responses, the person is unlikely to guess what is being measured

and behavior should be natural and reliable.

ug
QNO5 (a): Describe the role of test and other assessment techniques for improving

teaching learning process.


M
ANS: Large-scale assessments, like all assessments, are designed for a specific purpose. Those

used in most states today are designed to rank-order schools and students for the purposes of

accountability—and some do so fairly well. But assessments designed for ranking are generally

not good instruments for helping teachers improve their instruction or modify their approach to
i
dh

individual students. First, students take them at the end of the school year, when most

instructional activities are near completion. Second, teachers don't receive the results until two or

three months later, by which time their students have usually moved on to other teachers. And

third, the results that teachers receive usually lack the level of detail needed to target specific
E

improvements (Barton, 2002; Kifer, 2001).

12

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

The assessments best suited to guide improvements in student learning are the quizzes, tests,

writing assignments, and other assessments that teachers administer on a regular basis in their

classrooms. Teachers trust the results from these assessments because of their direct relation to

classroom instructional goals. Plus, results are immediate and easy to analyze at the individual

L
student level. To use classroom assessments to make improvements, however, teachers must

change both their view of assessments and their interpretation of results. Specifically, they need

ha
to see their assessments as an integral part of the instruction process and as crucial for helping

students learn.

Despite the importance of assessments in education today, few teachers receive much formal

ug
training in assessment design or analysis. A recent survey showed, for example, that fewer than

half the states require competence in assessment for licensure as a teacher (Stiggins, 1999).

Lacking specific training, teachers rely heavily on the assessments offered by the publisher of
M
their textbooks or instructional materials. When no suitable assessments are available, teachers

construct their own in a haphazard fashion, with questions and essay prompts similar to the ones

that their teachers used. They treat assessments as evaluation devices to administer when

instructional activities are completed and to use primarily for assigning students' grades.
i
dh

To use assessments to improve instruction and student learning, teachers need to change their

approach to assessments in three important ways.

Make Assessments Useful


E

For Students

13

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

Nearly every student has suffered the experience of spending hours preparing for a major

assessment, only to discover that the material that he or she had studied was different from what

the teacher chose to emphasize on the assessment. This experience teaches students two un-

fortunate lessons. First, students realize that hard work and effort don't pay off in school because

L
the time and effort that they spent studying had little or no influence on the results. And second,

they learn that they cannot trust their teachers (Guskey, 2000a). These are hardly the lessons that

ha
responsible teachers want their students to learn.

Nonetheless, this experience is common because many teachers still mistakenly believe that they

must keep their assessments secret. As a result, students come to regard assessments as guessing

ug
games, especially from the middle grades on. They view success as depending on how well they

can guess what their teachers will ask on quizzes, tests, and other assessments. Some teachers

even take pride in their ability to out-guess students. They ask questions about isolated concepts
M
or obscure understandings just to see whether students are reading carefully. Generally, these

teachers don't include such “gotcha” questions maliciously, but rather—often unconsciously—

because such questions were asked of them when they were students.
i

Classroom assessments that serve as meaningful sources of information don't surprise students.
dh

Instead, these assessments reflect the concepts and skills that the teacher emphasized in class,

along with the teacher's clear criteria for judging students' performance. These concepts, skills,

and criteria align with the teacher's instructional activities and, ideally, with state or district
E

standards. Students see these assessments as fair measures of important learning goals. Teachers

facilitate learning by providing students with important feedback on their learning progress and

by helping them identify learning problems (Bloom, Madaus, & Hastings, 1981; Stiggins, 2002).
14

- -

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

Critics sometimes contend that this approach means “teaching to the test.” But the crucial issue

is, What determines the content and methods of teaching? If the test is the primary determinant

of what teachers teach and how they teach it, then we are indeed “teaching to the test.” But if

desired learning goals are the foundation of students' instructional experiences, then assessments

L
of student learning are simply extensions of those same goals. Instead of “teaching to the test,”

teachers are more accurately “testing what they teach.” If a concept or skill is important enough

ha
to assess, then it should be important enough to teach. And if it is not important enough to teach,

then there's little justification for assessing it.

ug
QNO5 (b): Develop and achievement test by including selection type test items and supply

type test items. Give justification for use of both types of test items.
M
ANS: Type # 1. Objective Type Tests:

Objective type test items are highly structured test items. It requires the pupils to supply a word

or two or to select the correct answer from a number of alternatives. The answer of the item is
i

fixed one. Objective type items are most efficient to measure different instructional objectives.
dh

Objective type tests are also called as ‘new type tests’. These are designed to overcome some of

the great limitations of traditional essay type tests.

Objective type tests have proved their usefulness in the following way:
E

a. It is more comprehensive. It covers a wide range of syllabus as it includes a large number of

items.
15

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

b. It possesses objectivity of scoring. The answer in objective type test is fixed and only one and

it is predetermined. So that different persons scoring the answer script arrives at the same result.

c. It is easy to score. Scoring is made with the help of scoring key or a scoring stencil. So that

L
even a clerk can do the job.

d. It is easy to administer.

ha
e. Objective type tests can be standardized.

f. It is time saving.

ug
g. Objective type tests can measure wide range of instructional objectives.

h. It is highly reliable.
M
(a) Supply/Recall Type

(b) Selection/Recognition Type


i

(a) Supply/Recall Type:


dh

Supply type items are those in which answers are not given in the question. The students supply

their answer in the form of a word, phrase, number or symbol. These items are also called as

‘free response’ type items.


E

According to the method of presentation of the problem these items can be divided into two

types viz.,

16

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

(1) Short answer type

(2) Completion type

Example:

L
1. Short answer type:

ha
In which year the first battle of Panipath was fought? 1526 A.D.

2. Completion type:

ug
The first battle of Panipath was fought in the year 1526 AD.

In the first case the pupil has to recall a response from his past experience to a direct question.

These type of questions are useful in mathematics and physical science. But in the second case
M
the pupil may be asked to supply a word or words missing from a sentence. So in completion

type a series of statements are given in which certain important words or phrases have been

omitted and blanks are supplied for the pupils to fill in.
i

Principles of Constructing Recall Type Items:


dh

If the recall type items are constructed with the following principles then it will be more effective

and it will function as intended.


E

1. The statement of the item should be so worded that the answer will be brief and specific:

17

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

The statement of the problem should be such that it conveys directly and specifically what

answer is intended from the student.

Principles of Constructing True False Items:

L
While formulating the statements of the true false items the following principles should be

followed. So that the items will be free from ambiguity and unintentional clues.

ha
1. Determiners that are likely to be associated with a true or false statement must be

avoided:

ug
Broad general statements like usually, generally, often and sometimes give a clue that the

statements may be true. Statements like always, never, all, none and only which generally appear

in the false statements give clue to the students in responding it.


M
2. Those statements having little learning significance should be avoided:

The statements having little significance sometimes compel the students to remember minute

facts at the expense of more important knowledge and understanding.


i
dh

Uses of True False Items:

1. True false items are useful to measure varied instructional objectives. Some of the common

uses of true false items are given below.


E

18

https://www.facebook.com/groups/AIOU.EducationForAll
https://www.facebook.com/groups/AIOU.EducationForAll

2. It is used to measure the ability to identify the correctness of the statements, facts, definitions

of terms etc. True false items are useful in measuring the ability to distinguish facts from

opinion.

L
3. It is useful to measure knowledge concerning the beliefs held by an individual or the values

supported by an organization or institution.

ha
4. True false items are useful to measure the understanding of cause and effect relationship.

5. It is useful to measure the ability of the students for logical analysis.

Advantages of True-false Items:


ug
a. True-false items provide a simple and direct means of measuring essential outcomes.

b. All the important learning outcomes can be tested equally well with true-false items like other
M
objective type items.

c. The probability of an examinee achieving a high score on a true false test by guessing blindly

is extremely low.
i
dh

d. It uses few statements directly from text books.

e. It possesses very powerful discriminating power.


E

f. It is easy to construct.

19

- -

https://www.facebook.com/groups/AIOU.EducationForAll

Potrebbero piacerti anche