www.assess.

com

Instructions for the Classical Item and Test Analysis Spreadsheet (CITAS)
1. Paste your data (ABCDE) in the blue data range on the "Input" tab
2. Paste your keys (ABCDE) in the blue keys range in the top row of the "Input" tab
3. Output will automatically populate on the "Output" and "Response counts" tabs

Note: The "Scored 0-1" tab is calculations only, and is locked to preserve accuracy

CITAS is limited to 50 items and 50 people. For larger data sets and more functionality, please visit the webpages for Lertap
Lertap is an Excel-based classical analysis system with extensive documentation and functionality.
http://www.assess.com/xcart/product.php?productid=235&cat=0&page=1
Iteman is a classical analysis program designed to work with text (txt or dat) files.
http://www.assess.com/xcart/product.php?productid=234
he webpages for Lertap and Iteman.
 Keys: B C C D B D D B D B A D D C C D A B B B
Item responses:
Person Score ID 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
1 14 Ex001 A D C D A D A C D B A A D C C D A B B B
2 15 Ex002 A D C D B D A C D B A B D C C D A B B B
3 13 Ex003 A D C D B D A A D A A B D C C D A B A B
4 15 Ex004 A D C D B D A C D B A A D C C D A B B B
5 14 Ex005 A D C D B D A C D B A D D C C A A B B A
6 12 Ex006 A D C A B A A C A B A D D C C D A B B A
7 12 Ex007 A D C D B D A C D B A A D C C A A B C D
8 13 Ex008 D D A D B D A C D B A A D C C D A B B D
9 13 Ex009 A D C D B D A C D B A A D C C D A C B C
10 14 Ex010 A C C D B D A C D C A A D C C D A B B C
11 14 Ex011 A D C D B D A C D B A A D C C D A B B C
12 15 Ex012 A D C D B D A C D B A A D C C D A B B B
13 14 Ex013 A D C D B D A C D C A A D C C D A B B B
14 14 Ex014 A D A D B D A C D B A A D C C D A B B B
15 13 Ex015 A D C D B D A C D B A A D C C D A A C B
16 15 Ex016 A D C D B D A C D B A A D C C D A B B B
17 15 Ex017 A D C D B D A C D B A A D C C D A B B B
18 12 Ex018 A D A D B D A C C B A A D C C D A B D B
19 9 Ex019 A A D D B D A D D B C C D D D A A B B A
20 15 Ex020 B D C D B D A C D B A A D C C D A B C B
21 14 Ex021 A D C D B B A C D B A B D C C D A B B B
22 14 Ex022 A B C D B D A C D B A A D B C D A B B B
23 14 Ex023 A D C D B D A C D B A A D C C B A B B B
24 15 Ex024 A D C D B D A C D B A A D C C D A B B B
25 14 Ex025 A D B D B D A C D B A A D C C D A B B B
26 15 Ex026 A D C D B D A C D B A A D C C D A B B B
27 14 Ex027 A D C D B D A C D B A A D C B D A B B B
28 16 Ex028 A D C D B D A B D B A A D C C D A B B B
29 14 Ex029 A D C D B D A D D B A A D C C D A D B B
30 15 Ex030 A D C D B D A C D B A A D C C D A B B B
31 12 Ex031 B D C D B B A C D B B C D C C C A D B B
32 14 Ex032 A D D D B D A C D B A A D C C D A B B B
33 15 Ex033 A D C D B D A C D B A A D C C D A B B B
34 15 Ex034 A D C D B D A C D B A A D C C D A B B B
35 15 Ex035 A D C D B D A C D B A A D C C D A B B B
36 10 Ex036 A D B D B B A C B B C C D D C D A B B B
37 15 Ex037 A D C D B D A C D B A A D C C D A B B B
38 15 Ex038 A D C D B D A C D B A A D C C D A B B B
39 15 Ex039 A D C D B D A C D B A A D C C D A B B B
40 7 Ex040 A D B D B D A C D C A A C B B D D C C B
41 14 Ex041 A D C C B D A C D B A B D C C D A B B B
42 14 Ex042 A D C D B D A C D B B A D C C D A B B B
43 15 Ex043 A C C D B D A C D B A A D C C B A B B B
44 15 Ex044 A D C D B D A C D B A B D C C D A B B B
45 10 Ex045 A D B D B D C C D B A C D C C B B C B C
46 16 Ex046 B D C D B D A C D B A A D C C D A B B B
47 13 Ex047 A D C D B C A C D B A A D C C B A B B B
48 8 Ex048 A D B D B B A C A C A A A C C D A A C B
49 14 Ex049 A D C D B D A C D B A A D C C D A C B B
50 15 Ex050 A D C D B D A C D B A A D C C D A B B B
 Keys: B C C D B D D B D B
Item responses:
Person ID Score 1 2 3 4 5 6 7 8 9 10
1 Ex001 14 0 0 1 1 0 1 0 0 1 1
2 Ex002 15 0 0 1 1 1 1 0 0 1 1
3 Ex003 13 0 0 1 1 1 1 0 0 1 0
4 Ex004 15 0 0 1 1 1 1 0 0 1 1
5 Ex005 14 0 0 1 1 1 1 0 0 1 1
6 Ex006 12 0 0 1 0 1 0 0 0 0 1
7 Ex007 12 0 0 1 1 1 1 0 0 1 1
8 Ex008 13 0 0 0 1 1 1 0 0 1 1
9 Ex009 13 0 0 1 1 1 1 0 0 1 1
10 Ex010 14 0 1 1 1 1 1 0 0 1 0
11 Ex011 14 0 0 1 1 1 1 0 0 1 1
12 Ex012 15 0 0 1 1 1 1 0 0 1 1
13 Ex013 14 0 0 1 1 1 1 0 0 1 0
14 Ex014 14 0 0 0 1 1 1 0 0 1 1
15 Ex015 13 0 0 1 1 1 1 0 0 1 1
16 Ex016 15 0 0 1 1 1 1 0 0 1 1
17 Ex017 15 0 0 1 1 1 1 0 0 1 1
18 Ex018 12 0 0 0 1 1 1 0 0 0 1
19 Ex019 9 0 0 0 1 1 1 0 0 1 1
20 Ex020 15 1 0 1 1 1 1 0 0 1 1
21 Ex021 14 0 0 1 1 1 0 0 0 1 1
22 Ex022 14 0 0 1 1 1 1 0 0 1 1
23 Ex023 14 0 0 1 1 1 1 0 0 1 1
24 Ex024 15 0 0 1 1 1 1 0 0 1 1
25 Ex025 14 0 0 0 1 1 1 0 0 1 1
26 Ex026 15 0 0 1 1 1 1 0 0 1 1
27 Ex027 14 0 0 1 1 1 1 0 0 1 1
28 Ex028 16 0 0 1 1 1 1 0 1 1 1
29 Ex029 14 0 0 1 1 1 1 0 0 1 1
30 Ex030 15 0 0 1 1 1 1 0 0 1 1
31 Ex031 12 1 0 1 1 1 0 0 0 1 1
32 Ex032 14 0 0 0 1 1 1 0 0 1 1
33 Ex033 15 0 0 1 1 1 1 0 0 1 1
34 Ex034 15 0 0 1 1 1 1 0 0 1 1
35 Ex035 15 0 0 1 1 1 1 0 0 1 1
36 Ex036 10 0 0 0 1 1 0 0 0 0 1
37 Ex037 15 0 0 1 1 1 1 0 0 1 1
38 Ex038 15 0 0 1 1 1 1 0 0 1 1
39 Ex039 15 0 0 1 1 1 1 0 0 1 1
40 Ex040 7 0 0 0 1 1 1 0 0 1 0
41 Ex041 14 0 0 1 0 1 1 0 0 1 1
42 Ex042 14 0 0 1 1 1 1 0 0 1 1
43 Ex043 15 0 1 1 1 1 1 0 0 1 1
44 Ex044 15 0 0 1 1 1 1 0 0 1 1
45 Ex045 10 0 0 0 1 1 1 0 0 1 1
46 Ex046 16 1 0 1 1 1 1 0 0 1 1
47 Ex047 13 0 0 1 1 1 0 0 0 1 1
48 Ex048 8 0 0 0 1 1 0 0 0 0 0
49 Ex049 14 0 0 1 1 1 1 0 0 1 1
50 Ex050 15 0 0 1 1 1 1 0 0 1 1

P: 0.06 0.04 0.80 0.96 0.98 0.88 0.00 0.02 0.92 0.90
Rpbis: 0.09 0.09 0.67 0.07 -0.03 0.42 0.49 0.43
Sum corr: 43 29 572 657 669 614 0 16 641 627
Sum incorr: 640 654 111 26 14 69 683 667 42 56
Num corr: 3 2 40 48 49 44 0 1 46 45
Num Incorr: 47 48 10 2 1 6 50 49 4 5
Mean corr: 14.33 14.50 14.30 13.69 13.65 13.95 16.00 13.93 13.93
Mean incorr: 13.62 13.63 11.10 13.00 14.00 11.50 13.66 13.61 10.50 11.20
Min corr: 12 14 12 7 7 7 0 16 7 9
Max incorr: 16 16 14 14 14 14 16 16 12 14
PQ: 0.06 0.04 0.16 0.04 0.02 0.11 0.00 0.02 0.07 0.09

Test statistics
Examinees: 50
Items: 20
Mean: 13.66
SD: 1.9337
Variance: 3.7392
Min: 7
Max: 16
KR-20: 0.6424
SEM: 1.1563

Item statistics
Mean P: 0.68
Min P: 0.00
Max P: 0.98
Mean Rpbis: 0.35
Min Rpbis: -0.07
Max Rpbis: 0.67
A D D C C D A B B B

11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 0 1
1 0 1 1 1 1 1 1 1 1
1 1 1 1 1 0 1 1 1 0
1 1 1 1 1 1 1 1 1 0
1 0 1 1 1 0 1 1 0 0
1 0 1 1 1 1 1 1 1 0
1 0 1 1 1 1 1 0 1 0
1 0 1 1 1 1 1 1 1 0
1 0 1 1 1 1 1 1 1 0
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 0 0 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 0 1
0 0 1 0 0 0 1 1 1 0
1 0 1 1 1 1 1 1 0 1
1 0 1 1 1 1 1 1 1 1
1 0 1 0 1 1 1 1 1 1
1 0 1 1 1 0 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 0 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 0 1 1
1 0 1 1 1 1 1 1 1 1
0 0 1 1 1 0 1 0 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
0 0 1 0 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 0 0 0 1 0 0 0 1
1 0 1 1 1 1 1 1 1 1
0 0 1 1 1 1 1 1 1 1
 1 0 1 1 1 0 1 1 1 1
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 0 0 0 1 0
1 0 1 1 1 1 1 1 1 1
1 0 1 1 1 0 1 1 1 1
1 0 0 1 1 1 1 0 0 1
1 0 1 1 1 1 1 0 1 1
1 0 1 1 1 1 1 1 1 1

0.92 0.04 0.96 0.92 0.94 0.84 0.96 0.84 0.86 0.82
0.37 -0.07 0.66 0.56 0.48 0.29 0.55 0.52 0.47 0.32
638 26 668 643 653 584 666 592 603 572
45 657 15 40 30 99 17 91 80 111
46 2 48 46 47 42 48 42 43 41
4 48 2 4 3 8 2 8 7 9
13.87 13.00 13.92 13.98 13.89 13.90 13.88 14.10 14.02 13.95
11.25 13.69 7.50 10.00 10.00 12.38 8.50 11.38 11.43 12.33
7 12 9 8 8 7 8 9 9 7 0 0 0 0 0
14 16 8 14 14 15 10 14 15 14 0 0 0 0 0
0.07 0.04 0.04 0.07 0.06 0.13 0.04 0.13 0.12 0.15
26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
41 42 43 44 45 46 47 48 49 50
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
 Person scores Item Statistics
Number Number Mean score
Person ID Score Item P Rpbis correct incorrect correct
1 Ex001 14 1 0.06 0.09 3 47 14.33
2 Ex002 15 2 0.04 0.09 2 48 14.50
3 Ex003 13 3 0.80 0.67 40 10 14.30
4 Ex004 15 4 0.96 0.07 48 2 13.69
5 Ex005 14 5 0.98 -0.03 49 1 13.65
6 Ex006 12 6 0.88 0.42 44 6 13.95
7 Ex007 12 7 0.00 0 50
8 Ex008 13 8 0.02 1 49 16.00
9 Ex009 13 9 0.92 0.49 46 4 13.93
10 Ex010 14 10 0.90 0.43 45 5 13.93
11 Ex011 14 11 0.92 0.37 46 4 13.87
12 Ex012 15 12 0.04 -0.07 2 48 13.00
13 Ex013 14 13 0.96 0.66 48 2 13.92
14 Ex014 14 14 0.92 0.56 46 4 13.98
15 Ex015 13 15 0.94 0.48 47 3 13.89
16 Ex016 15 16 0.84 0.29 42 8 13.90
17 Ex017 15 17 0.96 0.55 48 2 13.88
18 Ex018 12 18 0.84 0.52 42 8 14.10
19 Ex019 9 19 0.86 0.47 43 7 14.02
20 Ex020 15 20 0.82 0.32 41 9 13.95
21 Ex021 14 21
22 Ex022 14 22
23 Ex023 14 23
24 Ex024 15 24
25 Ex025 14 25
26 Ex026 15 26
27 Ex027 14 27
28 Ex028 16 28
29 Ex029 14 29
30 Ex030 15 30
31 Ex031 12 31
32 Ex032 14 32
33 Ex033 15 33
34 Ex034 15 34
35 Ex035 15 35
36 Ex036 10 36
37 Ex037 15 37
38 Ex038 15 38
39 Ex039 15 39
40 Ex040 7 40
41 Ex041 14 41
42 Ex042 14 42
43 Ex043 15 43
44 Ex044 15 44
45 Ex045 10 45
46 Ex046 16 46
47 Ex047 13 47
48 Ex048 8 48
49 Ex049 14 49
50 Ex050 15 50
 Summary
Mean score
incorrect Statistic Value
13.62 Test statistics Want to learn more about item analysis?
13.63 Examinees: 50 We recommend these introductory books:
11.10 Items: 20
13.00 Mean: 13.66 Measurement Theory in Action: Case Studies and Exercises
14.00 SD: 1.93 Shultz & Whitney
11.50 Variance: 3.74 http://assess.com/xcart/product.php?productid=68&cat=6&page=1
13.66 Min: 7
13.61 Max: 16 Psychometrics: An Introduction
10.50 KR-20: 0.64 Furr & Bacharach
11.20 SEM: 1.16 http://assess.com/xcart/product.php?productid=460&cat=6&page=
11.25
13.69 Item statistics
7.50 Mean P: 0.68
10.00 Min P: 0.00
10.00 Max P: 0.98
12.38 Mean Rpbis: 0.35
8.50 Min Rpbis: -0.07
11.38 Max Rpbis: 0.67
11.43
12.33
Case Studies and Exercises

php?productid=68&cat=6&page=1

php?productid=460&cat=6&page=1
 Frequencies Mean Score

Item A B C D E A B C D
1 46 3 0 1 0 13.63 14.33 13.00
2 1 1 2 46 0 9.00 14.00 14.50 13.72
3 3 5 40 2 0 13.00 9.80 14.30 11.50
4 1 0 1 48 0 12.00 14.00 13.69
5 1 49 0 0 0 14.00 13.65
6 1 4 1 44 0 12.00 11.00 13.00 13.95
7 49 0 1 0 0 13.73 10.00
8 1 1 46 2 0 13.00 16.00 13.72 11.50
9 2 1 1 46 0 10.00 10.00 12.00 13.93
10 1 45 4 0 0 13.00 13.93 10.75
11 46 2 2 0 0 13.87 13.00 9.50
12 39 5 4 2 0 13.97 14.20 10.25 13.00
13 1 0 1 48 0 8.00 7.00 13.92
14 0 2 46 2 0 10.50 13.98 9.50
15 0 2 47 1 0 10.50 13.89 9.00
16 3 4 1 42 0 11.67 13.00 12.00 13.90
17 48 1 0 1 0 13.88 10.00 7.00
18 2 42 4 2 0 10.50 14.10 11.00 13.00
19 1 43 5 1 0 13.00 14.02 11.00 12.00
20 3 41 4 2 0 11.67 13.95 12.75 12.50
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
E
More detailed distractor analysis is available with Lertap or Iteman:
Lertap:
http://www.assess.com/xcart/product.php?productid=235&cat=0&page=1
Iteman:
http://www.assess.com/xcart/product.php?productid=234
Person ID Score Item P DescriptionRpbis DiscriminatAccept/rev
1 Ex001 14 1 0.06 very difficu 0.088867 very poor revise
2 Ex002 15 2 0.04 very difficu 0.089572 very poor revise
3 Ex003 13 3 0.8 very easy 0.668665 good accept
4 Ex004 15 4 0.96 very easy 0.070378 very poor revise
5 Ex005 14 5 0.98 very easy -0.025373 very poor reject
6 Ex006 12 6 0.88 very easy 0.416679 acceptable accept
7 Ex007 12 7 0 very difficu 0 very poor revise
8 Ex008 13 8 0.02 very difficu 0 very poor revise
9 Ex009 13 9 0.92 very easy 0.486784 acceptable accept
10 Ex010 14 10 0.9 very easy 0.428363 acceptable accept
11 Ex011 14 11 0.92 very easy 0.37125 poor revise
12 Ex012 15 12 0.04 very difficu -0.070378 very poor reject
13 Ex013 14 13 0.96 very easy 0.656861 good accept
14 Ex014 14 14 0.92 very easy 0.563807 acceptable accept
15 Ex015 13 15 0.94 very easy 0.483049 acceptable accept
16 Ex016 15 16 0.84 very easy 0.292969 poor revise
17 Ex017 15 17 0.96 very easy 0.550228 acceptable accept
18 Ex018 12 18 0.84 very easy 0.520961 acceptable accept
19 Ex019 9 19 0.86 very easy 0.470323 acceptable accept
20 Ex020 15 20 0.82 very easy 0.324706 poor revise
Number corNumber incMean scoreMean score incorrect Statistic Value
3 47 14.33333 13.61702 Test statistics
2 48 14.5 13.625 Examinees: 50
40 10 14.3 11.1 Items: 20
48 2 13.6875 13 Mean: 13.66
49 1 13.65306 14 SD: 1.933697
44 6 13.95455 11.5 Variance: 3.739184
0 50 13.66 Min: 7
1 49 16 13.61224 Max: 16
46 4 13.93478 10.5 KR-20: 0.64241
45 5 13.93333 11.2 SEM: 1.156328
46 4 13.86957 11.25
2 48 13 13.6875 Item statistics
48 2 13.91667 7.5 Mean P: 0.683
46 4 13.97826 10 Min P: 0
47 3 13.89362 10 Max P: 0.98
42 8 13.90476 12.375 Mean Rpbis 0.354873
48 2 13.875 8.5 Min Rpbis: -0.070378
42 8 14.09524 11.375 Max Rpbis: 0.668665
43 7 14.02326 11.42857
41 9 13.95122 12.33333
Person ID Score z score rank
1 Ex001 14 0.299301 9.5
2 Ex002 15 0.964413 3.5 Mean 13.55
3 Ex003 13 -0.365812 14.5 Median 14
4 Ex004 15 0.964413 3.5 SD 1.503505
5 Ex005 14 0.299301 9.5
6 Ex006 12 -1.030925 18
7 Ex007 12 -1.030925 18
8 Ex008 13 -0.365812 14.5
9 Ex009 13 -0.365812 14.5
10 Ex010 14 0.299301 9.5
11 Ex011 14 0.299301 9.5
12 Ex012 15 0.964413 3.5
13 Ex013 14 0.299301 9.5
14 Ex014 14 0.299301 9.5
15 Ex015 13 -0.365812 14.5
16 Ex016 15 0.964413 3.5
17 Ex017 15 0.964413 3.5
18 Ex018 12 -1.030925 18
19 Ex019 9 -3.026263 20
20 Ex020 15 0.964413 3.5