Appendix

A Professional Development Rubric

We would appreciate knowing how you rate this professional development in comparison to inform it's future and continued improvement. Please complete the following survey to inform our future designs and improvements. Content (what) Q1 Domain specific content presented is current and novel to participants m m m m m Strongly disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Q2 Domain specific content is accurately represented without errors m m m m m Strongly disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5

Audrey De Zeeuw 4/21/13 12:58 PM Comment [1]: This rating depends on the experience of the participant. If it is their first time teaching a subject, then the domain specific content could potentially be new. However, if the participant is experienced in the content area, this might be redundant.

Q3 Domain specific content addresses both common and novel misconceptions m m m m m Strongly disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 12:59 PM Comment [2]: Because of the planning phase of the lesson cycle, where the group creates goals derived from their needs as well as the standards and existing curriculum, this would be rated very high (4/5). Hopefully, in a group of educators, there would be minimal if any incorrect content delivered. Audrey De Zeeuw 4/21/13 1:01 PM Comment [3]: This depends on the group members, but would be rated fairly high (3/4) because of the learning community dynamic of a lesson cycle group. Through the discussion of the rational for the lesson, any misconceptions and the above incorrect content would be brought to light and corrected.

Q4 Content presented to participants is relevant to their classroom experience m m m m m Strongly disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Q5 Pedagogical skills and strategies are current and novel to participants m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:01 PM Comment [4]: A lesson study is conducted within the classroom, with the goals in relation to what is occurring in the classroom. Audrey De Zeeuw 4/21/13 1:02 PM Comment [5]: Again, this depends on experience in the classroom. For some members of the lesson study group, suggestions from other group members might be new or novel, or perhaps they would be old hat.

 Q6 Program provides participants opportunities to explore and assume new roles, expectations and responsibilities m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:03 PM Comment [6]: When done correctly, over the course of a few weeks, months, years, every group member will assume a different role as the teacher of the lesson, observer, and even perhaps a moderator of the discussion post-lesson.

Q7 Please list any other topics or issues related to content that you would like to include in future professional developments. Process (how) Q8 The professional development was planned with an appropriate theory of action. m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Q9 The professional development was organized in a way that was appropriate for the audience m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:07 PM Comment [7]: The theory behind lesson study is based on the participant-observer experience paired with the idea of a professional learning community. The only reason this is not rated a 5 is because I am unclear if teachers are aware of the theory of action when the engage in a lesson study.

Q10 The objectives of the professional development were clearly presented to all participants m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:08 PM Comment [8]: Because the first and second steps of the lesson study center around the participants creating their own goal and a plan of action to meet that goal, IF all participants are engaging and sharing their learning needs, the organization of the lesson cycle should be appropriate for the audience

Q11 There was a portion of the professional development that extended beyond its initial delivery m Yes m No Q12 The quality of initial training m m m m Very Bad (1) Bad (2) Poor (3) Neither Good nor Bad (4)

Audrey De Zeeuw 4/21/13 1:09 PM Comment [9]: Again, if participants are engaging in the first steps of the lesson study, they will have a chance to ask questions of the group and clear up any issues they have with the objectives of the lesson. But, if they are part of the creation of the goals, this should not be an issue. Audrey De Zeeuw 4/21/13 1:10 PM Comment [10]: Because lesson study is an on going cycle, there is a potential for it to never end.

m Fair (5) m Good (6) m Very Good (7) Q13 The quality of follow up m m m m m m m Very Bad (1) Bad (2) Poor (3) Neither Good nor Bad (4) Fair (5) Good (6) Very Good (7)

Q14 What were components of the follow up portion of the professional development? Q15 Please list any other topics or issues related to process of the delivery of this professional development that you would like to include in future professional developments.

Context (who, when, where, why) Q16 The professional development encouraged a professional learning community m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Q17 The professional development encouraged teacher leadership within the PLC m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:14 PM Comment [11]: A corner of the theoretical framework for lesson study is a PLC and I do not think a lesson study could be accomplished without a PLC.

Q18 The professional development used data to inform design m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:15 PM Comment [12]: If the lesson study is enacted appropriately and group roles are switched through each iteration, every teacher will have the opportunity to serve as a teacher leader. Audrey De Zeeuw 4/21/13 1:17 PM Comment [13]: The lesson study does not explicitly suggest using data to inform the goals of the cycle. However, I suspect teachers will use data and information about their student to create the goals.

Q19 The professional development used data to inform implementation m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Q20 The professional development provided sufficient time for adoption m m m m m Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:18 PM Comment [14]: The data teachers gather throughout their observation will be used as points of discussion during the post- observation portion of the lesson study. Teachers will gather and use data as evidences as part of the lesson studys implementation. Audrey De Zeeuw 4/21/13 1:21 PM Comment [15]: One of the greatest strengths about lesson study is the fact that it is ongoing. Throughout its implementation, teachers are given time to discuss their rational for incorporating or not incorporating a suggested change and data about how that decision influenced their classroom. This provides participants with sufficient time to negotiate using the cycle.

Q21The professional development provided sufficient time for refinement m Strongly Disagree (1) m Disagree (2)

m Neither Agree nor Disagree (3) m Agree (4) m Strongly Agree (5) Q22 The professional development considered various components of school culture in its design m m m m m Q23 Please list any other topics or issues related to the context of this professional development that you would like to include in future professional developments. Strongly Disagree (1) Disagree (2) Neither Agree nor Disagree (3) Agree (4) Strongly Agree (5)

Audrey De Zeeuw 4/21/13 1:22 PM Comment [16]: Again, because lesson study is an ongoing cycle, participants are given time to work through any issues they have with the cycle or components of the cycle.

Audrey De Zeeuw 4/21/13 1:23 PM Comment [17]: This depends on the participant goals set at the beginning of the cycle. Most likely, their goals will reflect school culture, but there is a chance, they may simply reflect short-term goals such as student standardized test performance.