Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
CORE STANDARDS
I. Introduction ............................................................................................................................. 3
II. Methodology ........................................................................................................................... 5
a. Prototype ............................................................................................................................. 5
b. Learners............................................................................................................................... 6
c. Tryout Process ..................................................................................................................... 6
1) Pre- & Post-Test (Appendix A) ..................................................................................... 6
2) Observation ..................................................................................................................... 7
3) Questionnaire .................................................................................................................. 8
4) Tryout Conditions .......................................................................................................... 8
III.
a.
b.
c.
d.
Results.................................................................................................................................... 9
Entry conditions .................................................................................................................. 9
Instruction ......................................................................................................................... 10
Outcomes ........................................................................................................................... 11
Recommendations............................................................................................................. 13
I.
Introduction
As states continue the process of implementing the Common Core State Standards in
schools across the nation, new ideas on how to prepare teachers to enact the standards into their
classroom are emerging. This instructional design project seeks to create an eLearning module
that will prepare teachers with the necessary skills, tools and ideas to successfully teach
technology-integrated lessons in the context of the Common Core State Standards.
In 2010, more than 40 states adopted a new set of educational standards for students
called the Common Core State Standards (CDE, 2013). These standards provide a clear and
consistent understanding of what students are expected to learn at each grade level, regardless of
the state in which they live. As these new standards are being implemented in schools across the
country, schools nationwide are looking for different ways to integrate them into current
curriculum. According to a report issued by Education First, The majority of states reported that
they have at least begun the process of developing plans to align their systems to CCSS by:
providing professional development to teachers (45 states), changing or devising curriculum
guides and other instructional materials (35 states), and revising the teacher-evaluation system
(38 states) (Porter, 2012). However, during the beginning phase of implementation, researchers
found that the focus of attention has shifted toward issues related to practical implementation,
such as the readiness for teachers to actually enact the new standards in the classroom (Porter,
2012).
The new standards include rigorous academic expectations at the highest levels and are
designed to ensure that high school graduates are prepared to go to college. They also
century workforce, both nationally and globally. The International Society for Technology of
Education (ISTE) created a list of technology standards in 2008 for both teachers and students in
which many schools have adopted. The ISTE argue that if teachers want to be effective, they
should incorporate technology in all of their lessons. Teachers need to be prepared to use
technology effectively to meet the rigorous learning goals embedded in Common Core
Standards by providing access to tools and resources that personalize instruction and create rich,
engaging and relevant learning environments (ISTE, 2012). This project will design an
eLearning module that will give teachers the appropriate technology skills and tools needed to
successfully implement one section of the English Language Arts Common Core Standards: The
Anchor Standards for Writing. First, it will provide an exact definition and easy-to-understand
interpretation of each standard. Next, the module will highlight the technology embedded within
each standard and provide demonstrations and/or simulations of the necessary technological
skills needed to implement the standard. Finally, the module will provide technology ideas for
integration in the classroom.
The prototype for this analysis is an online eLearning module entitled Technology
Integration for the Common Core Standards, which was built on Adobe Captivate 7. The
eLearning module will focus on the English Language Arts Anchor Standards for Writing, in
particular for grades 6-8. The module will introduce the learner to a brief orientation to each of
the standards with a focus on technology and will also provide the learner with the skills and
ideas needed for successful implementation in the classroom.
In order to analyze the effectiveness of this module, a combination of items were used,
including a pre- and post-test, a Google Forms survey questionnaire, and an observation
II.
Methodology
a. Prototype
The module is designed to provide technology instruction to middle school instructors
teaching grades 6-8. The module is specifically designed to prepare teachers with the appropriate
technology skills to teach Common Core State Standards in grades 6-8. The purpose and course
objectives are clearly outlined at the beginning of the module along with an explanation of the
Common Core State Standards and technology integration. The module focuses on Writing:
Standard 6, which states that students must use technology to produce and publish writing as
well as collaborate with others (Common Core State Initiative, 2010). In order to fulfill this
requirement, the module focuses on the use of Google Docs as a form of writing and
collaboration amongst students.
The module provides the user with an audio narration of the course objectives along with
the guided steps included in the training. The narration provides the user with instructions on
where to begin the training. The module follows the structure principle in its overall design and
navigation. Navigation for the content is placed in a table of contents menu on the left-hand side
of the screen with designated tabs for the various topics of the course. The current menu tab in
(Appendix D).
3) Questionnaire
At the end of the observation, each user was instructed to complete an online
Google Forms survey questionnaire regarding their overall satisfaction with the module
(Appendix E). The survey included questions regarding user satisfaction in relation to
overall clarity, module navigation, and efficiency/satisfaction. The survey questions were
specifically designed to gain feedback in relation to the most commonly adhered to
general principles in instructional design (Lockwood, 2014), including user interface
consistency, navigation design, language accuracy, use of color and contrast, and
intuitable/logical design. Also, the survey included questions regarding the effectiveness
of the course instruction.
4) Tryout Conditions
In order to create a structured and organized environment for all users, the tryout
process including all observations, were completed in a classroom at a local middle
school in the Monterey area. Users completed paper copies of the pre-test. Users were
notified that they could either bring in their own laptop computer or use the school
equipment. Available school computer equipment included desktop PC computers with
17-inch monitors and Bose companion speakers for the audio narration of the module.
Users that brought in their own computer equipment brought in either Macintosh laptops
or PC laptops with internal speakers. The classroom setting allowed for the tryout to be
III.
Results
The results for this analysis included an examination of the pre- and post-test
results in order to determine learning achievement after completing the module. Since preand post-test results were compared, this analysis fit the description of a repeated measure,
which would utilize a dependent sample t-test. A t-test for dependent samples would help
determine the possible existence of a statistically significant difference between the two test
results, pre- and post-test. In addition, results were calibrated from the Google Forms survey
in order to determine the effectiveness of the module in relation to the most commonly
implemented general principles of instructional design.
a. Entry conditions
The module was designed and intended for middle school teachers. All users, with
the exception of the parent of a middle school student, were credentialed instructors with
experience ranging from one year, up to 25 years. The intended entry conditions aligned
with the observed conditions. For example, all of the users were relatively familiar with
the Common Core State Standards since their implementation will take place this
upcoming school year. Also, all the users had basic knowledge of technology, including
word processing, Internet searches, and Gmail accounts. Finally, users had little or no
knowledge of Google Docs as a tool for fulfilling the technology requirements designated
by the Common Core State Standards. Moreover, users had only general knowledge of
b. Instruction
The intended and observed instructions were also generally congruent. The
intended instruction was for the users to identify the connection between the Common Core
State Standards, its technology requirements and the ways in which the use of Google Docs
may fulfill these requirements. Additionally, the intended instruction was for users to
produce a Google Doc by creating or uploading a document. Finally, the intended instruction
was for users to publish a document by sharing with other Gmail users or by publishing to
the web. Since the module distinctly separated the lesson phases into four steps, the observed
instruction was clear throughout the training. Step 1: Provided a direct-instruction
demonstration of the process for producing and publishing a Google document. Based on the
observation checklist utilized throughout the tryout process, the users were able to
independently follow along with this phase of direct instruction.
Step 2: Provided a guided practice phase of instruction where users selected the
appropriate location for various items, signing in to a Gmail account as well as creating and
publishing a Google document. In this phase of the instruction, the module provided text
captions along with the narrated audio in order to guide the user throughout the tasks. Based
on the observation checklist, users were again able to independently maneuver the various
tasks. Step 3: Provided an independent practice of the previously practiced tasks. According
11
locations on the screen in order to complete the tasks without any assistance. Therefore, the
intended and observed instructions were generally congruent as users were able to
demonstrate knowledge of the tasks required by the module.
c. Outcomes
An examination of the assessment outcomes for this module indicated a
statistically significant difference between pre- and post-test results. The pre- and post-test
had a total of 6 items with four of the items worth 10 points (40 points total) and two of the
items worth 30 points (60 points total) for an overall total of 100 points for the entire test.
Both pre and post-test results were calculated and utilized to conduct a paired two-sample ttest to test for significance. Since the pre- and post-test results are repeated measures of a
users performance, a dependent paired two-sample t-test was appropriate to analyze the
outcome results (Appendix F). An analysis of the t-test revealed the following: (|t|=3.162 >
2.015). Since the t-stat is greater than the t-critical value, the null hypothesis can be rejected,
thereby yielding statistically significant results. An analysis of the p-value results also
indicates a statistically significant result. In relation to the p-value, the t-test demonstrated the
following: (0.025 < 0.05). Since the p-value is less than the designated 0.05, then once again
the null hypothesis may be rejected, thereby demonstrating a statistically significant increase
in user learning. Test reliability was accurate since the same items were used for both the
pre- and the post-test. Utilizing the same test items provided an accurate reading of the users
prior knowledge regarding the subject matter and knowledge gained after completing the
module.
IV.
module that will prepare teachers with the necessary skills, tools, and ideas to successfully
teach technology-integrated lessons in the context of the Common Core State Standards. The
eLearning module includes clear descriptions of each standard and its correlation to
technology. It also includes tools and ideas for implementation that are relevant to the current
needs of teachers as well as providing demonstrations and simulations to be able to
effectively and appropriately teach the standard. It complements and supplements current
curriculum which allows teachers to go through the module at their own pace, repeating
lessons as necessary to ensure comprehension. Finally, it provides assessments and
knowledge checks as part of the learning experience.
The tests provided in this analysis generated a number of fascinating observations.
These observations may help to provide further clarification on the effectiveness of an
eLearning course. The commonality in the results show that, in the most general sense, all
users either agree or strongly agree with the effectiveness regarding the knowledge,
understanding, effectiveness, and satisfaction of the eLearning course specializing in
Common Core Standards. Meanwhile, recommendations have been given as well. The
16
Common Core State Standards Initiative (2010). Common Core state standards for English
language arts & literacy in history/social sciences, science, and technical
subjects. Retrieved from http://www.corestandards.org/the-standards
ISTE, (2012). In ISTE position Statement on the Common Core State Standards. Retrieved Mar.
9, 2014, from https://www.iste.org/standards/common-core
Lockwood, Nancy (2014). User interface. [Microsoft Word document]. Retrieved from Lecture
Notes Week 6 iLearn Web site:
https://ilearn.csumb.edu/mod/resource/view.php?id=170195
Porter, W., Riley, R., & Towne, L. (n.d.). Preparing For Change: A National Perspective on
Common Core State Standards Implementation Planning. Ed Week. Retrieved July 13, 2014,
from https://www.iste.org/standards/common-core
___ Publish
___ Share
17
18
b. Observation Script
Welcome to this usability test for an online e-learning module. During this tryout session,
you will first complete a ten-question pre-test regarding the use of technology in the
classroom. Then, you will complete an online training module on the use of technology,
specifically Google Docs, in the classroom. The module is intended to increase your knowledge
regarding the use of Google Docs as a tool for fulfilling the upcoming Common Core State
Standards and its technology requirements. Please go through the module as directed by the
audio narration. During the final portion of the module, you will complete a ten-question posttest that assesses your knowledge after completing the various lessons in the module. Finally,
you will complete an online Google Survey in which you will provide feedback on the
module. This feedback will allow the developer of the module to make any necessary changes
and improvements that will better support user learning. Thank you for your cooperation.
c. Sample responses to user questions during tryout process
1. User: The button/link is not working to go to the next page?
Developer: Is there anything else you could try to troubleshoot the problem?
2. User: I cant back to the main page. What should I do?
Developer: Is there anywhere on the screen where you can go for help with this issue?
19
Yes No Comments
20
Question #3:
The course content was logically organized.
21
Question #5:
The use of color was appropriate throughout the module.
22
Question #7:
My knowledge and/or skills have significantly increased as a result of this course.
23
24
Please write one comment about the effectiveness of the instruction in this module.
The step-by-step instructions provide for effective learning. It is easy to follow along with what
the module is explaining because it includes a how its done, where to click, and what happens
next component.
Question #9:
Please write one comment about the effectiveness of the overall design of this module.
The overall design is very clean and easy on the eyes. The screen capture design was by far the
most user-friendly component because everything viewed in the module is what we would be
faced with when we practiced. This allows for the ability to recall information.
Question #10:
Please write one recommended improvement for the module.
A recommendation would be an option to play, pause, fast-forward, and rewind the module and
narration. Incorporating this into the eLearning module would allow users to work at their own
individualized pace, providing an opportunity to take notes, rewind if something was missed, or
fast forward if that knowledge was already learned.
71.66666667
85
Variance
176.6666667
110
Observations
Pearson Correlation
Variable 2
0.645607935
df
t Stat
-3.16227766
P(T<=t) one-tail
0.012515508
t Critical one-tail
2.015048372
P(T<=t) two-tail
0.025031016
t Critical two-tail
2.570581835
25
60
Post-Test
40
20
0
1
26