skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Theory-based Evaluation of Lesson Study Professional Development: Challenges, Opportunities, and Lessons Learned
“Lesson study” has garnered considerable attention from educational researchers and practitioners as a promising method for improving instruction. At its core, lesson study reflects a collaborative inquiry process, grounded in cycles of planning, enacting, and reflecting, that promotes teacher learning through active engagement in lesson refinement. In this article, we leverage lesson study as an exemplar case to foreground an examination and application of theory-based evaluation. We overview a novel evaluation framework contextualized to this multidimensional instructional program and draw out the contributions of theory-based evaluation to the study of program effects. To ground the description of this framework, we summarize representative findings from our ongoing evaluation of a lesson study-based instructional program and discuss processes for selecting, using, and managing evidence sources as well as determining causal strands supporting program outcomes. We conclude by discussing lessons learned and implications for theory-based evaluation of complex programs.  more » « less
Award ID(s):
1852139
PAR ID:
10439648
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
American Journal of Evaluation
Volume:
45
Issue:
2
ISSN:
1098-2140
Format(s):
Medium: X Size: p. 292-312
Size(s):
p. 292-312
Sponsoring Org:
National Science Foundation
More Like this
  1. The field of computer science continues to lack diverse representation from women and racially minoritized individuals. One way to address the discrepancies in representation is through systematic changes in computer science education from a young age. Pedagogical and instructional changes are needed to promote meaningful and equitable learning that engages students with rigorous and inclusive curricula. We developed an equity-focused professional development program for teachers that promotes culturally responsive pedagogy in the context of computer science education. This study provides an overview of our culturally responsive framework and a qualitative examination of how teachers (n=9) conceptualized and applied culturally responsive pedagogy in their classrooms. Drawing from grounded theory and lesson assessment rubrics, we developed a codebook to analyze teacher interviews, lesson plans, and questionnaire responses. Findings revealed that, following their participation in professional development, teachers were consistently planning to implement a wide range of culturally responsive instructional and pedagogical practices capable of promoting diversity, equity, and inclusion in computer science education. 
    more » « less
  2. The field of computer science continues to lack diverse representation from women and racially minoritized individuals. One way to address the discrepancies in representation is through systematic changes in computer science education from a young age. Pedagogical and instructional changes are needed to promote meaningful and equitable learning that engages students with rigorous and inclusive curricula. We developed an equity-focused professional development program for teachers that promotes culturally responsive pedagogy in the context of computer science education. This study provides an overview of our culturally responsive framework and a qualitative examination of how teachers (n=9) conceptualized and applied culturally responsive pedagogy in their classrooms. Drawing from grounded theory and lesson assessment rubrics, we developed a codebook to analyze teacher interviews, lesson plans, and questionnaire responses. Findings revealed that, following their participation in professional development, teachers were consistently planning to implement a wide range of culturally responsive instructional and pedagogical practices capable of promoting diversity, equity, and inclusion in computer science education. 
    more » « less
  3. Lischka, A. E.; Dyer, E. B.; Jones, R. S.; Lovett, J.; Strayer, J.; & Drown, S. (Ed.)
    Describing and measuring instructional quality of mathematics lessons is a common goal amongst mathematics education researchers. Such work takes several forms such as classifying and coding instructional moves and student activity or providing high-level rubric-based scores in relation to categories. In this work, we share an innovative mixed methods approach to analyzing lesson data that includes both a time-based classification of instruction and an overall scoring component. Using the Math Habits framework, our project team analyzed a set of 97 fourth-eighth grade mathematics lessons including overall scores. From this qualitative analysis, we developed quantitative models to predict overall scores and better understand the ways that individual codes do or do not contribute to overall lesson score characterizations. 
    more » « less
  4. This study focuses on a lesson study adaptation for bridging prospective teachers’ experiencesin a methods course and their field experiences in a teacher education program in Puerto Rico. We ask, what opportunities for teacher learning emerge during discussions in lesson study? Two lesson study teams of secondary mathematics prospective teachers, each led by an experienced mentor, planned technology-based lessons. Using the theoretical framework for lesson study by Lewis and colleagues, we analyzed video recordings of the teams’ discussions. The results show learning opportunities in the three dimensions of the framework: teachers’ knowledge and beliefs, the creation of a professional community, and the development of teaching–learning artifacts. The mentors leveraged prospective teachers’ knowledge, built on topics discussed in the methods course, and created a professional learning community. Three resources introduced in the methods course supported the creation of a hybrid space connecting academic and practitioner knowledge: shared language about teaching moves for using technology in math instruction, the mathematical proficiency framework, and a lesson plan template. The mentors drew upon their subject matter and pedagogical knowledge during their facilitation of lesson study. The intervention exemplifies a lesson study adaptation that is feasible in the context of a teacher education program. 
    more » « less
  5. This paper clarifies and expands the definition of teacher professional practice, grounded in the commonplaces of professionalism outlined by Lee Shulman. We present the Professional Development: Research, Implementation, and Evaluation (PrimeD) framework as a lens for transforming professional development into a practice that engages teachers as professionals. This discussion explores teachers’ roles in both their classrooms and the profession. The inclusion of PrimeD evaluation and research in the development and practice of mathematics teachers addresses Shulman’s professionalism commonplaces. PrimeD was tested as a lens for professionalism in mathematics teacher education programs at four universities. In the study, teachers collaborated as professionals on developing and testing novel ways to approach mathematics lessons. In general, teachers’ efforts to conduct structured experimentation in their lessons were disconnected from traditional views of the role of a teacher. As a result, teachers who did develop and test lesson trials in this PD program did not frequently continue experimentation. Typically, teachers wanted to collaborate on testing classroom activities but did not have resources to do so (e.g., time, collaborative planning). Systemic changes are needed to promote sustainable change, allowing teachers to collaborate and share the results of classroom research. 
    more » « less