Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Quartet of Twos
Nathaniel Caeton
Project Manager/Graphic Designer
Bobbie Kirkpatrick
Designer
Younga Macharro
Client Liaison/Designer
Ilknur Oded
Facilitator/Writer
August 8, 2017
Table of Contents
Introduction ......................................................................................................................... 3
Project Description.............................................................................................................. 3
Evaluation ........................................................................................................................... 7
Teamwork ........................................................................................................................... 9
Challenges ......................................................................................................................... 10
References ......................................................................................................................... 13
APPENDICES .................................................................................................................. 13
GROUP DESIGN REPORT 3
Introduction
Our client, Dr. Yvonne Walker, wanted us to develop a stand-alone module that will help
supervisors develop and enhance their skills in managing employees requiring discipline. Hence,
Monterey County Human Resources Departments one-day, face-to-face course titled, Key
Practices for Successful Supervisors (KPSS). The main objective of the module is to help
supervisors in selecting and executing the most appropriate disciplinary actions. The learners
Project Description
We were tasked to create a module highlighting the main topic areas within the Countys
B. Pre-disciplinary Options
1. Performance Evaluation/PIP
2. Counseling
GROUP DESIGN REPORT 4
3. Verbal Warning
4. Written Warning
C. Disciplinary Options
1. Written warning
2. Written reprimand
4. Reduction in salary
5. Disciplinary demotion
6. Termination
the content covered during the KPSS (Key Practices for Successful Supervisors) mandatory
course. We created this section in html format, with an overview of the 9 portions of the Wheel
and document samples for each portion. The Performance Management Wheel is available in the
following link:
The Positive Progressive Discipline Course portion was created in Captivate and provides
the learners with opportunities to enhance their critical thinking skills through in-depth learning
GROUP DESIGN REPORT 5
interactions and case scenarios provided by HR Program Manager and Employee Relations
Course Link
Course Pretest
Note that at the beginning of the training, there is a short video by Jan Holmes, Deputy
County Council explaining why this training is important and what it covers in general terms.
This video was recorded by the client and edited by our team.
an initiative to help managers and supervisors to have the skills and tools about progressive
discipline. Through our discussions with the client, we have reasonable degree of certainty that
at least some supervisors do not possess the necessary skills and knowledge about progressive
discipline. Therefore, we believe that providing support for developing knowledge and skills in
this area through a Captivate module and supporting html digital reference section on the
Performance Management Wheel will help achieve the clients goals of making sure that: a)
Country supervisors are familiar with the tools and options about progressive discipline, and b)
1
Pretest was made in a separate Captivate project according to Dr. Lara and Professor Challengers advice because
one Captivate module grades only one test.
GROUP DESIGN REPORT 6
Design Decisions
Changes in Content
The client, Dr. Yvonne Walker, provided us with the Key Practices for Successful
Supervision (KPSS) Workbook and during our initial meeting, she told us to concentrate on
Performance Management Matrix within the KPSS workbook. However, after Carol Cuella
(HR Program Manager and Employee Relations Coordinator) returned back from her vacation
and they had an internal discussion about the content to be covered, the decision was made to
change the focus of the training to Progressive Discipline without covering the matrix itself.
Therefore, we were provided with an outline that was organized by the client, which presented a
challenge as we needed to figure out the right content matching this new outline about
Progressive Discipline.
Additionally, as per the clients request, we were asked to provide a brief overview of the
Performance Wheel Review at the beginning of the training. In order to overcome the
challenge of covering both the Performance Wheel Review and the numerous subtopics under
the Progressive Discipline section, we needed to make some changes in the format which is
Changes in Format
We decided to create the Performance Wheel Review section in html format and then
placed links for it within the Captivate module. Keeping this section within the Captivate module
would overwhelm the learners as the information presented within Progressive Discipline is quite
heavy on its own. Additionally, the Performance Management Wheel in html serves as an easy to
access job-aid for supervisors instead of being buried in a Captivate module of a disciplinary
course. When we communicated this to the client, she agreed to having the Performance Wheel
Review section in html format, which will be placed in the Countys server.
Evaluation
As noted by Brenneman (1989), testing with single subject has been successfully
undertaken for self-instructional and computer-based materials (p. 22). This is the method we
chose to evaluate the effectiveness of our training taking into consideration the time constraints.
In order to conduct single-subject testing, we asked our client, Dr. Walker, to recruit a member
of the target audience. Our client liaison met her at the County Office and conducted the
usability testing. Our usability survey was created by using Google Forms and is available in the
link below:
While conducting the usability testing, we followed the guidelines for single-subject
testing provided in Brenneman (1989). The feedback that we received following the single-
The subject agreed or strongly agreed with She made the following suggestions
the following:
Based on the above feedback, we added learning objectives to the title page of each
module and provided instructions for each activity in a clearer way. Some of our observations
and additional findings after conducting the usability testing were as follows:
There was no learning gain between pre-assessment and post-assessment although the
subject strongly agreed with both of these statements in the usability survey: a) The lesson
GROUP DESIGN REPORT 9
In an interview after the testing, she suggested some test items be reworded to a clearer
way and some key points be highlighted in the course. Additionally, we found that although
using tab interaction is effective to hold a lot of content on the same slide, some important points
get buried. In future revisions of the module, we are planning to create multiple slides instead of
using tab interaction so that more effective learning activities can be used.
Teamwork
We had a strong team that worked harmoniously and efficiently. We collaborated at each
phase of the project and provided continuous feedback to each other by using Google Docs. The
main division of labor that we had in our team is as follows (although when needed everyone
These were the top three things that worked particularly well in our team:
GROUP DESIGN REPORT 10
1. We get started working on the project as soon as our project is assigned and provided
2. We set up a clear schedule with major milestones at the very beginning of our project and
made sure that we stick to our schedule through regular zoom team meetings, and
3. We set up a group text message room to ensure quicker communication among the
Challenges
As noted above, we started working on our project as soon as the project is assigned.
However, we ran into some challenges along the way. Here are the top three challenges and how
1. Ms. Carol Cuellar, Employee Relation Coordinator, was on vacation until July 17, 2017.
Although we contacted the client, Dr. Yvonne Walker, as soon as possible and had our
first Zoom meeting with her on June 24, 2017, exact content and depth of coverage that
we needed for the project (e.g. finalized content topics and case scenarios) were not
available until Ms. Cuellar returned from her vacation. We have overcome this challenge
by maintaining constant communication among team members and doing our best to
meet the milestone deadlines with all the information we have received from the client.
2. The unfamiliarity of the client with ADDIE process and training procedures presented
some challenges. For instance, we had some trouble in setting up an appointment for
conduct a single-subject usability testing, she was not familiar with the concept. We have
GROUP DESIGN REPORT 11
overcome this challenge by immediately communicating with the client and clarifying
what we needed. Our client liaison, Younga Machorro, communicated with the client in a
However, the fact that the client misunderstood the purpose of a prototype presented a
scheduled. The client did not get back to us until August 7, one day before our deadline
to submit our final product. Additionally, the last-minute feedback that we received on
August 7 consisted of a long list of comments and suggestions for revisions which are
impossible to complete within one day. We have overcome this challenge by completing
the revisions that can be done within one day and then separating out the revisions that
cannot be achieved in such a short period of time. We informed the client that these
revisions will be completed later on and she agreed to having the finalized version of the
3. We had heavy content that would exceed the one-hour completion time for learners as
well as the time frame that we needed to design a Captivate module. As noted earlier, we
have overcome this challenge by putting some of the content (i.e. Performance
Management Wheel) in html format and placing essential content topics in Captivate
module.
GROUP DESIGN REPORT 12
Although this was a challenging task (especially due to the time constraints), it was an excellent
learning experience. As advice to future students, we would like to offer the following:
Start as soon as you are assigned the project and ask the client to clearly define the
When you set up your schedule, leave some extra time for development and evaluation
phases so that you can have some more time to revise the project if needed
At the very beginning of the project, you need to educate your client a little bit about
ADDIE Process and familiarize him/her with some instructional training concepts. For
instance, communicate to your client that you will need to conduct usability testing with a
member of the target audience and clarify what it means so that the client can make the
If you intend to develop your training by using Captivate, make it clear to the client that
making revisions in Captivate takes time. It is crucial that the client provides timely
Hold regular team meetings and if this is not possible, make sure to maintain
communication among team members via email/text. It is very helpful to set up a text
messaging group to maintain constant communication and to keep everyone in the loop.
Be flexible. If you see that the content is heavier than you have expected (like we did)
consider using different formats and different ways of creating the final project
GROUP DESIGN REPORT 13
Finally, clearly communicate what you have in mind to your team members and support
your team members as needed. Collaboration and clear communication are the key to a
successful project.
References
Brenneman, J. (1989). Why You cant Use a Crowd: Single-Subject Testing. Performance
Walker, Y., & Cuellar, C. (2015) Key Practices for Successful Supervision [PowerPoint
slides].
APPENDICES
Appendix 1
Blue font represents what was done before receiving this feedback.
Red font represents what was done after receiving this feedback.
Assessment) Captivate
If names are needed for record keeping purposes, you may want to say module so
First and Last Names or ask for county email addresses in addition to that LMS can
information
Slide 4 Perhaps add an arrow highlighting where on the wheel we're at Adde
(Performanc d
Managemen
t Wheel)
(Objectives) Course
Objectives
instead of
Objectives.
In the content- Be aware of the resources available to you to assist you Change
progressive
Reviewer 3: Larger print for bullet points. More color? I think you're
working on this
highlighted
Memorandu
ms of
Understandin
Larger print
GROUP DESIGN REPORT 16
finished
Slide 8 Reviewer 1: I think the upward sloping diagonal arrow is a bit Used a
(Contents) deceptive because at first, my eye did not know where to begin reading different
because the final step is closer to the top of the page. My eye did not layout
Reviewer 3: Suggestion to change the order of the arrows from top The words
disciplinary
Disciplinary
were
highlighted
GROUP DESIGN REPORT 17
Perhaps define just cause as you do due process on the next slide.
Added
Added
Reviewer 3: Words are cut off in slide; unable to review full content; quotation
marks to at-
will
Word
off. Gave
more padding
Carol question about adding property rights of position discussion; any to the bottom
additional language that refers to the 7 tests of just cause that need to not to be
be added? misguiding
GROUP DESIGN REPORT 18
Slide 11 Reviewer 1: What to do to follow it- we can make the Skelly Process used a bigger
(Due font size little bigger than the rest of the content in this area font size
definition. changed to
with Due
Adde
knowledge
check. It
GROUP DESIGN REPORT 19
starts from
(True/False) press y on
screen, was able to press y on keyboard and that worked, but unclear
Slide 15 Reword Question. Awkward. Shouldn't end with "With". But I dont This is from
choice) pretest.
Slide 11 and Skelly rights are mentioned in Slide 11 and the employee is told that the moved this
17 term will be defined later in the course. But then the term comes up question after
again as the correct answer for the Knowledge Check question on slide introducing
17. Skelly
Perhaps the term should be defined earlier in the course or the question process in
(Pre- Under the tab How to Do- Do not understand the last point exact quote
(There is no requirement to )
Disciplinary from KPSS
Options) Workbook p.
13. We are
to fix it.
Should we
delete it?
Under the tab Tips- We can make supervisory file font size a
little bigger than the rest of the content.
As documentation is very important. We can increase the font size
for Dont forget to document
used a bigger
Have directions to click each tab to learn more written above the tabs
Because there
is insufficient
space above
confused by this bullet point. Are you asking the manager/supervisor to highlighted in
consider examining their own work style? Perhaps that bullet should a different
misnomers because the bullet points are not steps, they are more akin to
what to do
GROUP DESIGN REPORT 21
statute of limitations?
Highlighted it
in a different
color
Slide 20 Reviewer 1: Can we use the same heading (Pre-Disciplinary Options & finished
(Pre- Steps) for both in the main heading and content heading instead of
Options &
Steps) Is there a third bullet point under the tab Written Notice steps? The third
bullet was
Reviewer 2: Can you arrange for the options buttons that you click to removed
be highlighted or grayed out so that you can see where you are in the
list of options? Then you will know which button you need to click next
out in the
GROUP DESIGN REPORT 22
slide; there is
not enough
If there are four counseling approaches please number them or space on the
highlight them in some way. Else, give them their own slide rather than button.
Numbered
Cite the work rule(s) that are violated. Would it be clearer to use them.
the policy
Options and Steps suggestions - write the how for managers and each
supervisors for each area; step increase is not in MOU it is in PPPR; approach.
the work group in the problem solving as this could be basis for a
Slide 22 I think this is a very important point. It's somewhat buried in the TIP Highlighted it
color
Slide 24 The correct answer info regarding medical condition is the Corrected
(Multiple correct answer, but when it is selected, the course says to go back to the
wrong
Slide 25 I like how you provided more information in the Correct-Answer Than
choice)
Slide 26 Got this one wrong! Twice. Reread Slide. I like that I'm Than
Drop)
GROUP DESIGN REPORT 24
(Disciplinar ponder/consider
y Options)
supervisor / manager; add with input from HR professional; take out part this
the boldface print portion this is not the practice; add under tips refers to.
perceived as retaliatory
Slide 28 Can we use the same heading (Disciplinary Options & Steps) for changed
both in the main heading and content heading instead of
(Disciplinar
Disciplinary Option Steps
y Options &
Under the tab, Suspension/ Involuntary leave without pay. Write in
Steps full PPPR- (Personnel Policies and Practices Resolution) Wrote it out
Added
add 5 key elements as on other slides; on cover slide change to
proposed notice of discipline on all slides; add reference to final This content
was given to
GROUP DESIGN REPORT 25
verification.
Slide 28 and Number the steps or include a graphic that will indicate order of The question
was replaced
to a different
question.
Slide 30 I was able to arrange them after some trial and error. Can you use a A
(Sequence) different format where there are also Five blank spaces labeled First, drag and drop
into the correct order was confusing how to rank them when no slots
or boxes when needed to use the cursor to drag them into the correct
order
Slide 35 Reviewer 1: 5 Key Elements to Redirect Behavior can be the changed the
(Taking Subheading or make the text larger to highlight that the elements are title to
Elements to
Redirect
Behavior in
your
GROUP DESIGN REPORT 26
disciplinary
document.
Removed the
38 since these
slides seem
It is a bit confusing given the less punitive/less negative use of the term
document.
(1))
time
GROUP DESIGN REPORT 27
Reviewer 2: I love the case scenarios. This is where the learning takes Thank you.
Slide 48 The head of the person in the stock image is cut off. Removed the
(Conclusion image
General Comments
The slides look Awesome!!! Great job!!! I liked the way contents were organized in the slides.
- This course would benefit from a quick overview of any buttons and the sidebar function (if
either of these are included in the final version). I am not sure if everyone will be able to
navigate the course without at least an infographic pointing out the various buttons on the
screen and their functions.
- There should be a command labeled << Back as well as a command labeled Next >>.
- I think that directions should be clearly written into the slides throughout the course. Perhaps
in italic type in a light-colored box whenever a new type of question is posed (drag + drop,
order of magnitude, etc.) because not all employees are accustomed to the navigation of
online courses.
- The content of this course seems to have been created under the assumption that little time
has elapsed between the time when the employee completes KPSS and the time that this
GROUP DESIGN REPORT 28
course is taken. Legal terms are not always highlighted or defined and acronyms are written
as acronyms.
Employees who are new to the County or to supervision in general may be unfamiliar
with these terms. It is advisable to continually define County vocabulary and spell out
It is not clear if this course will be a post-KPSS assignment or an optional elective, but
perhaps the employee may choose to take this course years after completing KPSS and only
if a particular issue happens to arise. Thus, it may be best to re-define (and possibly
underline/bold/italicize or put in quotation marks) all legal terminology and write out all
acronyms. This occurs periodically throughout the slides but is not consistent.
- Consider the use of department, County or even Monterey County rather than
agency as appropriate.
- The Knowledge Check questions in the early Knowledge check models seem rather easy.
Perhaps they could be made more challenging.
-
- I am guessing that an employee will not be permitted to skip answering the Knowledge
Check Questions. But what happens if they want to go backward to find an answer? Will
they need to answer previously completed Knowledge Check questions again?
Table of Contents can be used. TOC buttons were pointed out more clearly in Slide 2.
- Be mindful of terms like rules, policies and laws and when they are used in this course
material. Not every rule is a policy etc. Use these terms consistently.
- Make efforts to include ethnically and general diversity in the selection of stock photos.
the stock photo used in the background was removed; the image of Tom was replaced.
Done
GROUP DESIGN REPORT 29
- In the content area (Slide 11) it says, Skelly Process but in the multiple-choice question the
answer is Skelly rights. Could we use the same wording for both?
Skelly process was used instead of Skelly rights.
- Voice over, more scenarios and lots of sample documents will make this even better! Good
Job!
Sample documents were added in the version that was used for usability testing.
Adding more voice over needs more time and resource.
For more scenarios, we need SMEs help.