skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Revisiting purpose and conceptualisation in the design of assessments of mathematics teachers’ knowledge
In this paper, we focus on the design of assessments of mathematics teachers’ knowledge by emphasising the importance of identifying the purpose for the assessment, defining the specific construct to be measured, and considering the affordances of particular psychometric models on the development of assessments as well as how they are able to communicate learning or understanding. We add to the literature by providing illustrations of the interactions among these critical considerations in determining what inferences can be drawn from an assessment. We illustrate how the considerations shape assessments by discussing both existing and ongoing research projects. We feature discussion of two projects on which the authors of this paper are collaborating to demonstrate the affordances of attending to all three considerations in designing assessments of mathematics teachers’ knowledge to provide readers with opportunities to see those considerations in use.  more » « less
Award ID(s):
1751309 1813760 1054170
PAR ID:
10137874
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Research in Mathematics Education
ISSN:
1479-4802
Page Range / eLocation ID:
1 to 16
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract The complexity of mathematics teaching is especially evident in lessons where teachers build on students’ genuine ideas, such as problem-based lessons. To enhance teachers’ capacity for rich discussions in problem-based instruction, we have developed a unique approximation of practice: digital asynchronous simulations where teachers make subject-specific decisions for a virtual teacher avatar. The simulations are based on materials and principles from a practice-based professional development (PD) program, implemented with small groups of teachers. The self-paced simulation model offers flexibility and scalability, allowing more teachers to participate on their own schedules, but it lacks key affordances of collaborative PD. To examine how to leverage the affordances of collaborative, practice-based PD, this paper uses a design-based research approach to explicate the mechanisms in which digital simulations can support mathematics teachers’ learning about problem-based lessons. We focus on two cycles of design, implementation, analysis, and revisions of the simulation model, drawing on data from focus groups with mathematics teacher educators, prospective teachers’ performance, and teachers’ reflective assignments. The analysis illustrates how two design principles –Authenticity to the teacher’s work, andNuanced feedback– were transformed to better reflect aspects of practice-based teacher learning. We argue that self-paced, asynchronous simulations with indirect feedback can effectively emulate aspects of collaborative, practice-based PD in supporting teachers’ growth. The paper also contributes to the literature on mathematics teachers’ noticing and decision-making, examining how the two interact in simulated environments. We suggest implications for designing practice-based asynchronous digital simulations, drawing on emerging technologies. 
    more » « less
  2. In this article we propose the use of Bayesian networks as a potentially promising way to model usable knowledge. Using the Classroom Video Analysis (CVA and CVA-M) assessments as a lab model for studying teachers’ usable knowledge, we first explored whether we can identify the knowledge (pieces) underlying teachers’ written responses. In the CVA approach we ask teachers to respond to short video clips of authentic classroom instruction based on different prompts that are designed to simulate common teaching tasks. We then explored the affordances of Bayesian networks to functionally model usable knowledge as an interconnected dynamic knowledge system consisting of different knowledge pieces and connected pathways weighted by situation-specific relevance and applicability. We explore the implications of these models for studying the development and growth of usable knowledge and propose the use of Bayesian networks as a novel and potentially promising way to model usable knowledge and for understanding how knowledge is used in teaching. 
    more » « less
  3. MCVT (Making Computing Visible and Tangible) Cards are a toolkit of paper-based computing cards intended for use in the codesign of inclusive computing education. Working with groups of teachers and students over multiple design sessions, we share our toolkit, design drivers and material considerations; and use cases drawn from a week-long codesign workshop where seven teachers made and adapted cards for their future classroom facilitation. Our findings suggest that teachers valued the MCVT toolkit as a resource for their own learning and perceived the cards to be useful for supporting new computational practices, specifically for learning through making and connecting to examples of everyday computing. Critically reviewed by teachers during codesign workshops, the toolkit however posed some implementation challenges and constraints for learning through making and troubleshooting circuitry. From teacher surveys, interviews, workshop video recordings, and teacher-constructed projects, we show how teachers codesigned new design prototypes and pedagogical activities while also adapting and extending paper-based computing materials so their students could take advantage of the unique technical and expressive affordances of MCVT Cards. Our design research contributes a new perspective on using interactive paper computing cards as a medium for instructional materials development to support more inclusive computing education. 
    more » « less
  4. Research shows formative assessments substantially strengthen learning and support summative assessment/evaluation practices. These practices are not widely applied in ATE's professional development (PD) efforts. This study focuses on participant teachers' assessment involvement to increase student learning and enhance outcome evaluations. We surveyed all principal investigators of ATE projects in 2022 who applied assessments in their 2021 PD efforts (N=70). Findings show that a minority of PD efforts apply formative assessment practices to strengthen PD outcomes or meet ATE's evaluation specifications. Assessment practices were most prevalent for summative purposes at the close of PD activity; a large majority assessed teachers' interest and learning in the PD and their intentions to use and teach what was learned on return to their classrooms. A third or less followed up to assess outcomes in teachers' schools. Similarly, thirty percent or less addressed matters of context at any stage of the PD efforts, and a few, 11 percent, followed up to assess the context in the schools. Concomitantly, the findings show where and how attention to formative assessment in the PD learning process can increase teacher involvement in assessment practices, making PD instruction more effective and strengthening outcome evaluations in participant teachers' home classrooms. 
    more » « less
  5. Teachers’ pedagogical content knowledge (PCK) is a complex, multifaceted construct that is widely seen as foundational to the act of teaching. In this synthesis, we investigated how the National Science Foundation’s (NSF’s) recent research investments have advanced understanding and supported the development of teachers’ PCK in PK–12 mathematics and science education. In the 5 years from 2011 to 2015, NSF’s Discovery Research PK–12 program (DRK-12) funded or cofunded 27 projects relating to PCK, totaling $62 million awarded. These 27 DRK-12 projects primarily applied correlational/observational and longitudinal methods (rather than quasi-experimental or experimental methods), often targeting teaching in the middle school grades. Our synthesis of empirical findings focused on how these projects studied PCK, including its measurement, development, and relationship to teaching and student learning. Link to PDF: https://www.air.org/sites/default/files/2022-05/Teachers-Pedagogical-Content-Knowledge-in-Math-and-Science-April-2022.pdf 
    more » « less