Sei sulla pagina 1di 4

Evaluating Education and Training Services: A Primer

Charles D. Hale, EdD


Professor, Educational Leadership Graduate Studies in Education School of Education and Social Services
&

Douglas Astolfi, PhD


Professor, History Department of History School of Arts and Sciences

Saint Leo University P. O. Box 6664 * St. Leo, Florida 33574

December 2007

Table of Contents Chapter 1 Research: An Introduction The Learning Organization Science and Research: The Relationship Research Ethics The Research Process, Plan, and Report Review Questions References Appendices 1.1 Pasco District Schools IRB Application Chapter 2 Psychometrics: Measurement Concepts + Constructs = Theory Research Variables Research Questions and Hypotheses Review Questions References Chapter 3 Psychometrics: Reliability, Validity, and Sampling Measuring in Measurement Classical Reliability Indices Validity Indices Direct Performance Assessment and Reliability Sampling in Research Design Review Questions References Appendices 3.1 Group Contribution Index Chapter 4 Psychometrics: Constructing Measures Planning the Measure Selecting Items for the Measure Review Questions References Appendices 4.1 Strategies Used for Assessing Student Learning Survey 4.2 Supervisor Communication Effectiveness 4.3 FRM 100 Foundations of Learning and Knowing Student Survey 4.4 Student Tutoring Satisfaction Survey 4.5 Self-Concept Scale 4.6 Likert Scale Item Response Formats Chapter 5 Psychometrics: Constructing Tests & Performance Assessments Introduction 1 1 4 7 8 13 15 16 18 18 22 34 36 40 42 42 43 52 59 61 64 68 69 71 71 77 83 86 87 89 90 92 93 94

96 96

Planning the Classic Classroom Achievement Test Constructing Select Response Items to Assess Knowledge, Comprehension, and Application Constructing Restricted and Extended Response Items to Assess Analysis, Synthesis, and Evaluation Statistical Strategies for Improving Select Response Test Items Preparing Examinees for a Testing Session Direct Performance Assessment References Appendices 5.1 Blooms Intellectual Skills Taxonomy 5.2 Interpretative Exercise Example 5.3 Task Specific, Analytical Scoring Rubric 5.4 Group Contribution Checklist 5.5 Skill Focused Scoring Rubric 5.6 Presentation Rating Rubric Chapter 6 Research Design: Secondary Research Conducting Secondary Research Constructing Literature Reviews or Literature Analyzes Review Questions Appendices 6.1 Framework for Assessing and Evaluating Research Articles Chapter 7 Research Design: Experimental Methods Controlling Research Bias and Design Threats Pre-experimental, Experimental, and Quasi-experimental Designs Review Questions References Chapter 8 Research Design: The Survey Survey Research Correlation and Ex-post Facto Research Review Questions References Appendices 8.1 Compete Survey Instrument and Codebook Chapter 9 Research Design: Qualitative Methods Qualitative Research: Process Qualitative Research Strategies Review Questions References Chapter 10 Statistical Foundations: Descriptive Statistics Introduction to Descriptive Statistics

98 107 117 120 124 131 138 140 143 144 147 148 149 151 151 158 160 163 167 167 171 177 179 181 181 188 189 190 191 201 201 205 211 214 215 215

Frequency Tables Figures Rates, Ratios, and Proportions Measures of Central Tendency, Skewness, and Variation Correlation Review Questions and Application Exercises Appendices 10.1 Math Symbols Chapter 11 Statistical Foundations: Hypothesis Testing Introduction Estimating a Population Parameter using Confidence Intervals The Logic of Hypothesis Testing Single and Two Sample Cases Review Questions References Chapter 12 Statistical Foundations: Prediction and Association The Pearson Product Moment Correlation Simple Linear Prediction Nonparametric Correlation Review Questions References Chapter 13 Statistical Foundations: Nominal and Ordinal Data Analysis Analyzing Nominal Data Analyzing Ordinal Data Review Questions References Appendix A Sample Research Plan or Grant Proposal Specifications & Quality Scoring Rubric Appendix B Budgeting Basics Appendix C Constructing Indexes: Recommendations for Improving Measurement Appendix D Standardized Testing: Introduction

217 218 224 224 227 231 235 236 236 238 241 245 254 255 256 256 258 259 262 264 265 265 276 284 285

287 294

301 323

Every effort has been made ensure accurate and complete documentation. If any errors or omissions are noted, please advise immediately to enable correction. charles.hale@saintleo.edu

Potrebbero piacerti anche