skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: EXPLORING THE RELATIONSHIP BETWEEN QUALITATIVE LESSON SCORES AND QUANTITATIVE QUALITIES OF INDIVIDUAL CODES
Describing and measuring instructional quality of mathematics lessons is a common goal amongst mathematics education researchers. Such work takes several forms such as classifying and coding instructional moves and student activity or providing high-level rubric-based scores in relation to categories. In this work, we share an innovative mixed methods approach to analyzing lesson data that includes both a time-based classification of instruction and an overall scoring component. Using the Math Habits framework, our project team analyzed a set of 97 fourth-eighth grade mathematics lessons including overall scores. From this qualitative analysis, we developed quantitative models to predict overall scores and better understand the ways that individual codes do or do not contribute to overall lesson score characterizations.  more » « less
Award ID(s):
1814114
PAR ID:
10439035
Author(s) / Creator(s):
; ; ;
Editor(s):
Lischka, A. E.; Dyer, E. B.; Jones, R. S.; Lovett, J.; Strayer, J.; & Drown, S.
Date Published:
Journal Name:
Proceedings of the forty-fourth annual meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Why do some mathematics lessons captivate high school students and others not? This study explores this question by comparing how the content unfolds in the lessons that students rated highest with respect to their aesthetic affordances (e.g., using terms like “intriguing,” “surprising”) with those the same students rated lowest with respect to their aesthetic affordances (e.g., “just ok,” “dull”). Using a framework that interprets the unfolding content across a lesson as a mathematical story, we examine how some lessons can provoke curiosity or enable surprise. We identify eight characteristics that distinguish captivating lessons and show how some, such as the average number of questions under consideration at any point in the lesson, are strongly related to student aesthetic experiences. In addition, the lessons that students described as more interesting included more instances of misdirection, such as when students’ false assumptions provide opportunities for surprising results. These findings point to the characteristics of future lesson designs that could enable more students to experience curiosity and wonder in secondary mathematics classrooms. 
    more » « less
  2. Ayalon, M; Koichu, B; Leikin, R; Rubel, L; Tabach, M (Ed.)
    Building on student work (SW) in mathematics classroom discussion requires complex decision-making from mathematics teachers. Previous literature on problem-based lessons recommends selecting and sequencing pieces of SW in a way that creates a mathematical storyline, but there is rarely any empirical evidence on how mathematics teachers can master such practices. We use the case of StoryCircles, a lesson-based professional development program, to show how iterative processes in which teachers were engaging with SW assisted them in developing heuristics for a careful selection and sequencing of SW. The results show that these processes involved 1) the teachers’ emerging awareness of features of SW; and 2) an evolving capacity to relate these features to the lesson goal. We discuss design features that fostered these changes. 
    more » « less
  3. Secondary students do not often have positive experiences with mathematics. To address this challenge, this paper shares findings of a design-based research project in which a mathematical story framework was used to design mathematically captivating lesson experiences (“MCLEs”). We provide evidence that designing lessons as mathematical stories shows promise. That is, students reported improved experiences in MCLEs when compared to randomly-selected lessons. The MCLEs also impacted the students’ descriptions of their experience. 
    more » « less
  4. “Lesson study” has garnered considerable attention from educational researchers and practitioners as a promising method for improving instruction. At its core, lesson study reflects a collaborative inquiry process, grounded in cycles of planning, enacting, and reflecting, that promotes teacher learning through active engagement in lesson refinement. In this article, we leverage lesson study as an exemplar case to foreground an examination and application of theory-based evaluation. We overview a novel evaluation framework contextualized to this multidimensional instructional program and draw out the contributions of theory-based evaluation to the study of program effects. To ground the description of this framework, we summarize representative findings from our ongoing evaluation of a lesson study-based instructional program and discuss processes for selecting, using, and managing evidence sources as well as determining causal strands supporting program outcomes. We conclude by discussing lessons learned and implications for theory-based evaluation of complex programs. 
    more » « less
  5. Sacristán, Ana Isabel; Cortés-Zavala, José Carlos; Ruiz-Arias, Perla Marysol (Ed.)
    The importance of curricular coherence has been emphasized by leaders in mathematics education, who explain that coherence enhances deeper understanding by enabling students to see connections between mathematical ideas. Although there are different forms of curricular coherence in teaching and learning mathematics, the coherence within a lesson has received considerably less attention. In particular, little is known about what constitutes coherent lessons or how to measure the degree of coherence. Using lesson data from a larger study in which lessons are intentionally designed for coherence, we propose a tool for examining lesson coherence and describe characteristics of the lessons with different levels of coherence. 
    more » « less