An official website of the United States government
Abstract This paper provides an experience report on a co‐design approach with teachers to co‐create learning analytics‐based technology to support problem‐based learning in middle school science classrooms. We have mapped out a workflow for such applications and developed design narratives to investigate the implementation, modifications and temporal roles of the participants in the design process. Our results provide precedent knowledge on co‐designing with experienced and novice teachers and co‐constructing actionable insight that can help teachers engage more effectively with their students' learning and problem‐solving processes during classroom PBL implementations. Practitioner notesWhat is already known about this topicSuccess of educational technology depends in large part on the technology's alignment with teachers' goals for their students, teaching strategies and classroom context.Teacher and researcher co‐design of educational technology and supporting curricula has proven to be an effective way for integrating teacher insight and supporting their implementation needs.Co‐designing learning analytics and support technologies with teachers is difficult due to differences in design and development goals, workplace norms, and AI‐literacy and learning analytics background of teachers.What this paper addsWe provide a co‐design workflow for middle school teachers that centres on co‐designing and developing actionable insights to support problem‐based learning (PBL) by systematic development of responsive teaching practices using AI‐generated learning analytics.We adapt established human‐computer interaction (HCI) methods to tackle the complex task of classroom PBL implementation, working with experienced and novice teachers to create a learning analytics dashboard for a PBL curriculum.We demonstrate researcher and teacher roles and needs in ensuring co‐design collaboration and the co‐construction of actionable insight to support middle school PBL.Implications for practice and/or policyLearning analytics researchers will be able to use the workflow as a tool to support their PBL co‐design processes.Learning analytics researchers will be able to apply adapted HCI methods for effective co‐design processes.Co‐design teams will be able to pre‐emptively prepare for the difficulties and needs of teachers when integrating middle school teacher feedback during the co‐design process in support of PBL technologies.
more »
« less
Teacher-Responses: Highlight characteristics of low response process validity for item(s) measuring teachers' pedagogical content knowledge
Response Process Validity (RPV) reflects the degree to which items are interpreted as intended by item developers. In this study, teacher responses to constructed response (CR) items to assess pedagogical content knowledge (PCK) of middle school mathematics teachers were evaluated to determine what types of teacher responses signaled weak RPV. We analyzed 38 CR pilot items on proportional reasoning across up to 13 middle school mathematics teachers per item. By coding teacher responses and using think-alouds, we found teachers' responses deemed indicative of low item RPV often had one of the following characteristics: vague answers, unanticipated assumptions, a focus on unintended topics, and paraphrasing. To develop a diverse pool of items with strong RPV, we suggest it is helpful to be aware of these symptoms, use them to consider how to improve items, and then revise and retest items accordingly.
more »
« less
- Award ID(s):
- 1813760
- PAR ID:
- 10456026
- Editor(s):
- Lischka, A. E.
- Date Published:
- Journal Name:
- Proceedings of the forty-fourth annual meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education
- Page Range / eLocation ID:
- 671-675
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Lamberg, T; Moss, D (Ed.)Mathematics teachers make numerous decisions that form lessons that in turn greatly influence what students learn. In making these decisions, teachers rely on their curricular reasoning (CR) to decide on what mathematics to teach, how to structure their lesson, and what problems or tasks to use to achieve their lesson goals. However, teachers differ with respect to the sophistication of their CR and the diversity of CR aspects used in their reasoning. In this paper, we detail two ways to classify teachers’ CR: a leveled approach to capture the increasing sophistication of teachers’ CR, and a heat map approach that highlights the extent to which teacher use various CR aspects in their planning. These methods provide stakeholders avenues by which CR can be studied and that teachers’ CR abilities can be further developed.more » « less
-
Lamberg, T; Moss, D (Ed.)Mathematics teachers make numerous decisions that form lessons that in turn greatly influence what students learn. In making these decisions, teachers rely on their curricular reasoning (CR) to decide on what mathematics to teach, how to structure their lesson, and what problems or tasks to use to achieve their lesson goals. However, teachers differ with respect to the sophistication of their CR and the diversity of CR aspects used in their reasoning. In this paper, we detail two ways to classify teachers’ CR: a leveled approach to capture the increasing sophistication of teachers’ CR, and a heat map approach that highlights the extent to which teacher use various CR aspects in their planning. These methods provide stakeholders avenues by which CR can be studied and that teachers’ CR abilities can be further developed.more » « less
-
null (Ed.)Selected response items and constructed response (CR) items are often found in the same test. Conventional psychometric models for these two types of items typically focus on using the scores for correctness of the responses. Recent research suggests, however, that more information may be available from the CR items than just scores for correctness. In this study, we describe an approach in which a statistical topic model along with a diagnostic classification model (DCM) was applied to a mixed item format formative test of English and Language Arts. The DCM was used to estimate students’ mastery status of reading skills. These mastery statuses were then included in a topic model as covariates to predict students’ use of each of the latent topics in their written answers to a CR item. This approach enabled investigation of the effects of mastery status of reading skills on writing patterns. Results indicated that one of the skills, Integration of Knowledge and Ideas, helped detect and explain students’ writing patterns with respect to students’ use of individual topics.more » « less
-
Generalizing is a critical aspect of mathematics learning, with researchers and policy documents highlighting generalizing as a core mathematical practice. It can also be challenging to foster in class settings, and teachers need access to better resources to teach generalizing, including an understanding of effective forms of instruction. This article proposes Classroom Supports for Generalizing (CSGs), investigating how multiple elements—such as tasks, teacher moves, student interactions, and representations—interact to meaningfully foster student generalizing. Drawing on class video data from a middle school teacher and two high school teachers, we present the CSG Framework, which identifies three categories of supports: Interactions for Generalizing, Structures for Generalizing, and Routines for Generalizing.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
