Educational Research

Chapter 3
Preparing and Evaluating a Research Plan

Gay, Mills, and Airasian

Topics Discussed in this Chapter

Characteristics of a research plan

General considerations in developing a
research plan
Components of a quantitative research
plan
Components of a qualitative research
plan
Evaluation of a research plan
Characteristics of a Research Plan

A research plan is a detailed description

of the procedures that will be used to
investigate your topic or problem.

Obj. A.1
Characteristics of a Research Plan

General components of a research plan

A justification for the hypotheses or
exploration of the research problem
A detailed presentation of the steps to be
followed in conducting the study

Obj. A.1
Characteristics of a Research Plan

Purposes of a written research plan

Forces the researcher to think through
every aspect of the study
Facilitates the evaluation of the proposed
study
Provides detailed procedures to guide the
conduct of the study

Obj. A.2
Characteristics of a Research Plan
Benefits of a written research plan
A well thought out research plan
saves time,
provides structure to the study,
reduces the probability of costly mistakes, and
generally results in a higher quality research
study.

Obj. A.3
General Considerations

Three general issues to consider when

developing a research plan
Ethics of research
Legal restrictions
Cooperation from participants
General Considerations
Ethics of research
Five ethical principles
Beneficence and non-malfeasance
Fidelity and responsibility
Integrity
Justice
Respect for peoples rights and dignity

Obj. 1.1
General Considerations
Legal restrictions
National Research Act of 1974
Protects participants
Protection from harm not exposing subjects to risks
Informed consent subjects participate of their own free
will with an understanding of the nature of the study and
possible risks
Stipulates that proposed research activities involving
human subjects must be reviewed and approved by an
authorized group
Internal Review Boards and Committees on Human
Subjects
Obj. 1.2 & 2.1
General Considerations

Legal restrictions
Family Educational Rights and Privacy Act
of 1974
Protects students privacy
Access to students records
Need for written permission to use data identifying
students
Known as the Buckley Amendment

Obj. 2.1
General Considerations

Two additional issues related to ethical

and legal responsibilities
Deception
Cooperation of participants
General Considerations
Deception
Situations in which complete information
related to the study is not given to participants
Such information would influence or change
participants responses
Studies can be negatively affected by informing
participants of certain details
Use of deceptive practices must be undertaken
very, very carefully

Obj. 1.2
General Considerations
Cooperation of participants
Gaining entry to the research site
Approval needed at several levels
Site

Administrators

Teachers

Students

Approval is not cooperation

Obj. 1.6
General Considerations

Cooperation from participants (continued)

Strategies to enhance cooperation
Clearly explain the benefits of the study
Afford stakeholders the opportunity to review drafts
of the report for their approval
Brief stakeholders on the findings
Provide professional development sessions for
stakeholders

Obj. 1.7
Quantitative Research Plans

Four major components

Introduction
Method
Data analysis
Timeline and budget

Obj. 3.1
Quantitative Research Plans
Introduction
Three sections
Statement of the topic
Review of the literature
Statement of the hypotheses
Statement of the topic
The topic is identified with a discussion of the
background and rationale
Stated at the beginning of the plan

Obj. 3.2
Quantitative Research Plans
Introduction (continued)
Review of the literature
Provides an overview of the topic and positions
the study in the context of what is known, and,
more importantly, what is not known about the
topic
Completed at the beginning of the study and
placed in the beginning of the plan

Obj. 3.2
Quantitative Research Plans
Introduction (continued)
Statement of the hypotheses
A formal statement specifying the hypothesis,
support for expected relationships between
variables, and operational definitions of all
variables
Hypotheses in quantitative studies are usually
deductively reasoned

Obj. 3.2
Quantitative Research Plans
Method
Five major sections
Participants
Instruments
Design
Procedures
Data analyses
Participants
Identifies the characteristics of the population and
sample as well as the sampling technique used
Quantitative studies typically use large samples and
probability sampling techniques
Obj. 3.3
Quantitative Research Plans
Method (continued)
Instruments
Descriptions of the specific measures of each variable,
the technical characteristics of the instruments, and the
administration and scoring techniques
Quantitative studies typically use non-interactive
instruments
Tests
Questionnaires
Surveys

Obj. 3.3
Quantitative Research Plans

Method (continued)
Design
Descriptions of the basic structure of the study
and the specific research design chosen
Quantitative studies typically use highly
structured, static designs

Obj. 3.3
Quantitative Research Plans
Method (continued)
Procedures
Detailed descriptions of all the steps that will be followed
in conducting the study, assumptions, and limitations
Gaining entry to the site
How subjects will be selected
The ways data will be collected and analyzed
Assumptions any important fact presumed to be true
but not verified
Limitations some aspect of the study that could have a
negative effect upon the results
Size of the sample
Length of the study
Obj. 3.3
Quantitative Research Plans
Method (continued)
Data analysis
Descriptions of the techniques used to analyze
the data
Descriptive statistics statistics that summarize data
in terms of central tendency (e.g., means), variation
(e.g., standard deviations), relative position (e.g.,
standard scores), or relationships (e.g., correlations)
Inferential statistics procedures used to infer the
likelihood of the results happening in the population
rather than just the sample

Obj. 3.3 & 3.4

Quantitative Research Plans
Method (continued)
Data analysis (continued)
The hypotheses usually determine the specific
research design which in turn influences the
specific analyses used
Quantitative studies usually focus on the
appropriate statistical procedures to analyze
numerical data

Obj. 3.3 & 3.4

Quantitative Research Plans
Timeline and budget
Timeline
Description of the major activities and
corresponding anticipated completion dates
Help assess the feasibility of conducting the
study
The resulting structure helps avoid
procrastination
A general strategy is to allow more time than
you initially think you will need!!!
Obj. 3.5 & 3.6
Quantitative Research Plans
Timeline and budget (continued)
Budget
Descriptions of anticipated costs that are likely
to be incurred
Salaries
Copying
Telephone
Travel
Optional in many plans

Obj. 3.5 & 3.6

Qualitative Research Plans
Qualitative studies are characterized by open-
ended, emergent designs
Research plans must be responsive to the
context and setting as well as the flexibility of
the design
The influence of prior fieldwork
The authors recommend pre-proposal fieldwork to
help understand the socio-cultural context of the
setting
Alternatives include drawing on ones own
experiences or the literature
Obj. 4.1 & 4.2
 Qualitative Research Plans
Additional ethical issues in qualitative
research
Unique emerging nature of qualitative designs
increases the likelihood of unanticipated and un-
reviewed ethical issues
Unique personal involvement with participants
raises issues
Objective collection and interpretation of data
Possibility of observing potentially illegal or
unprofessional behavior
Aligning professional and personal ethical
perspectives
Obj. 1.5
Qualitative Research Plans
Six general components
Title of the study
Introduction to the study
Research procedures
Potential contributions of the study
Limitations
Appendices

Obj. 4.3
Qualitative Research Plans

Title
Conveys key concepts of the study
Provides a framework for continued
reflection
Serves as a conceptual point of reference

Obj. 4.4
Qualitative Research Plans
Introduction
Four sections
Purpose statement
Framing the study
Initial research question
Related literature
Purpose statement
A clearly written, concise statement that sets
the stage for the rest of the plan

Obj. 4.5
Qualitative Research Plans
Introduction (continued)
Framing the study
An attempt to demonstrate the relevance of the
study using a frame of reference to which the
reader can relate
Describes the contribution of the study to
existing theory, educational policy, or the
solution of a practical problem

Obj. 4.5
Qualitative Research Plans
Introduction (continued)
Initial research question
Specifying research questions is difficult at this
stage given the ongoing, emergent nature of
qualitative research
Linked closely to the theory, policy, or practical
problem used to frame the study

Obj. 4.5
Qualitative Research Plans
Introduction (continued)
Review of the literature
Links the study to any underlying assumptions and
theories related to the initial research question
Accomplishes several things
Assesses the researchers preparedness to conduct the
study
Identifies potential gaps in the literature
Suggests promising educational practices
Refines the initial research question
Embeds the research questions in guiding hypotheses

Obj. 4.5
Qualitative Research Plans
Procedures
Eight sections
Description of the overall approach and rationale for the
study
Site and sample selection
Researchers role
Data collection methods
Data management methods
Data analysis strategies
Trustworthiness features
Ethical considerations

Obj. 4.6
Qualitative Research Plans
Procedures (continued)
Overall approach and rationale
Identifies the qualitative approach (e.g.,
ethnography, historical study, grounded theory,
etc.)
Provides the rationale for why the particular
approach is appropriate
Provides a link to the appropriate literature on
research methods
Obj. 4.6
Qualitative Research Plans
Procedures (continued)
Site and sample
Describes the rationale for choosing the
particular sample
Describes the process for gaining entry to the
site
Describes the site
Discusses the likelihood of building trusting
relationships with the participants
Obj. 4.6
Qualitative Research Plans
Procedures (continued)
Researchers role
Describes any negotiations needed to gain entry to the
site
Discusses participants expectations in terms of
reciprocity
Anticipates any ethical dilemmas
Data collection methods
Describes the fieldwork techniques and tools for
collecting data
Identifies multiple data sources

Obj. 4.6
Qualitative Research Plans
Procedures (continued)
Data management methods
Provides insights into ways by which the large
quantity of data will be manipulated
Data sources
Volume of data
Storage
Information such as times, dates, locations, etc.

Obj. 4.6
Qualitative Research Plans
Procedures (continued)
Data analysis strategies
Interpretive nature of the analyses of data from
fieldwork, observations, interviews, etc.
Describes procedures for collating data
Discusses the manner by which the data will be
categorized in terms of emergent themes
Provides a rationale for the conclusion and
interpretations
Obj. 4.6
Qualitative Research Plans
Procedures (continued)
Trustworthiness features
The researchers efforts to address traditional validity
and reliability issues
The use of triangulation multiple data sources and
collection methods
Ethical considerations
Demonstrates sensitivity to the ethical issues related to
informed consent
Describes the plan to obtain informed consent
States the researchers personal/professional ethical
perspectives
Obj. 4.6
Qualitative Research Plans
Potential contribution of the research
Describes how the study will contribute to an
understanding of the phenomenon being studied
Provides a link from the possible implications of
the study to the broader framework under which
the study was begun
Limitations
Discusses any limitations related to the
researchers ability to deal with situations over
which they have no control
Qualitative Research Plans
Appendices
Provide information helpful in assessing the
value and feasibility of the study
Timeline
Proposed table of contents
Sample consent form
Internal Review Board (IRB) approval
Sample of data collection protocols

Obj. 4.7
Evaluation of a Research Plan
Informal assessment
Critiques by the researcher, advisors, peers and
colleagues, etc.
Critiques by experienced researchers
Formal assessment
Field tests
Pilot studies
Modifications based on the results of both
informal and formal evaluations
Obj. 5.1 & 5.2