Braxton County Evaluation Plan

Lindsey Burnsed and Katrina Poff

FRIT 7237

Georgia Southern University

Implementation Evaluation

In the implementation evaluation, Braxton County and Great Southern University’s

implementation of the program will be evaluated. The following questions will be addressed by

the evaluation: Were the initial experience and follow up activities implemented as planned?

What is the quality of the initial program activities? Who are the program participants and how

were they recruited? What is the quality of follow up and support activities? The plan will use a

variety of methods in order to gain both qualitative and quantitative data to show a

comprehensive evaluation of the program. Data collection will be through a mixture of focus

groups, surveys, student work samples, observations, and a focus group.

Evaluation Data Collection Procedures/Data Analysis Timeline

Question Method & Source

P1: Were the * Focus Groups (with * Small groups of teachers will * October
initial experience interviews and be interviewed and observed 2015 - after
and follow up observations) using PBL. They will discuss first 9 weeks
activities * Surveys their initial experience and has ended (for
implemented as *Student Work Samples follow up activities. The group initial
planned? will be asked to rank how they experience)
feel PBL was implemented as
planned. The focus group will *January 2016
also be observed during (follow-up
lessons to determine the activities)
implementation of PBL in the
classroom.
* Surveys will be given out to
teachers who are implementing
PBL. Surveys will ask teachers
to rank their experiences and
implementation levels with
PBL. The answers will be
analyzed for similar responses
to determine overall teacher
perception of PBL
 implementation.
* The implementation will be
observed through the analysis
of student work samples by
GSU and Braxton
faculty/admin.

P2: What is the * Survey * Teachers will complete a October 2015-

quality of the * Observation/work survey about what activities after first 9
initial program samples were beneficial to their weeks has
activities? lessons. ended
* The quality of program
activities and student work
samples will be observed by
GSU and Braxton
faculty/admin.

P3: Who are the * Interview * School leaders will be *May 2015
program * Survey/Questionnaire interviewed to determine
participants and which teachers were chosen *July 2015
how were they and how they were chosen as
recruited? qualified candidates for this
program.
* Teachers will be given a
survey/questionnaire at the
“Introductions and New
Standards” meeting to
determine how they were
recruited and who they are.

P4: What is the * Focus Groups * Small groups of teachers will * January
quality of follow * Survey discuss the level of support and 2016
up and support * Interviews follow up activities provided
activities? by the study.
* All teachers will complete a
survey about how much
support they received
during/after the project.
* Individual interviews will be
conducted to clarify questions
brought up in the focus groups
and surveys.
Summative Evaluation

At the completion of the project, all four objectives will be evaluated by two questions: to

what extent were teachers able to develop PBL modules that were connected to local business

and industries, aligned with NSSM, and incorporated appropriate uses of technology?

(Objectives 1, 2, and 3), and to what extent were teachers able to implement and evaluate those

modules? (Objective 4). Teachers’ ability to create PBL modules that incorporate local

businesses and industries will be evaluated using rubrics and observations while the actual

implementation of these modules will be evaluated with surveys and focus groups. The Braxton

County teachers and Great Southern University faculty will report the successes and challenges

in the completion of this project.

Evaluation Questions Objective Indicator Data Source

To what extent were teachers Create PBL Modules draw on *Module rubric
able to develop PBL modules Modules based on content and *Observations
that were connected to local local businesses processes from
business and industries, aligned and industries local businesses
with NSSM, and incorporated and industries
appropriate uses of technology?
(Objectives 1, 2, and 3)

To what extent were teachers Create PBL Module content, *Module rubric
able to develop PBL modules Modules tasks, and *Observations
that were connected to local addressing NSSM assessments are
business and industries, aligned aligned with
with NSSM, and incorporated appropriate
appropriate uses of technology? NSSM
(Objectives 1, 2, and 3)
To what extent were teachers Integrate PBL modules *Module Rubric
able to develop PBL modules technology into contain activities *Observations
that were connected to local PBL experiences that effectively
business and industries, aligned use technology
with NSSM, and incorporated
appropriate uses of technology?
(Objectives 1, 2, and 3)

To what extent were teachers Implement and Record of *Surveys

able to implement and evaluate evaluate PBL implementation. *Focus group
those modules? (Objective 4) Modules
Record of
self-evaluation.

Data Collection Schedule

Data Set Date of Collection Instruments already Data Collected By:

developed?

Interviews May 2015 Yes Great Southern

January 2016 University faculty

Surveys (pre project, July 2015 Yes Great Southern

after initial October 2015 University faculty
implementation, post January 2016
project)

Focus Group October 2015 No Great Southern

January 2016 University faculty

Observations October 2015 Yes Great Southern

University trained
observers

Student work samples October 2015 No Braxton County

January 2016 teachers