Students often perform arithmetic using rigid problem-solving strategies that involve left-to-right-calculations. However, as students progress from arithmetic to algebra, entrenchment in rigid problem-solving strategies can negatively impact performance as students experience varied problem representations that sometimes conflict with the order of precedence (the order of operations). Research has shown that the syntactic structure of problems, and students’ perceptual processes, are involved in mathematics performance and developing fluency with precedence. We examined 837 U.S. middle schoolers’ propensity for precedence errors on six problems in an online mathematics game. We included an algebra knowledge assessment, math anxiety measure, and a perceptual math equivalence task measuring quick detection of equivalent expressions as predictors of students’ precedence errors. We found that students made more precedence errors when the leftmost operation was invalid (addition followed by multiplication). Individual difference analyses revealed that students varied in propensity for precedence errors, which was better predicted by students’ performance on the perceptual math equivalence task than by their algebra knowledge or math anxiety. Students’ performance on the perceptual task and interactive game provide rich insights into their real-time understanding of precedence and the role of perceptual processes in equation solving.
more »
« less
Assessment Designs that Elicit Multimodal Strategies: What We Can Learn about Early Childhood CT by Design
Performance assessments can provide meaningful insights into young children's knowledge; however, documenting assessment responses as incorrect or correct limits our understanding of students’ abilities. One method of improving our ability to measure student understanding is by documenting the strategies students use to engage with assessment tasks. In this study, we describe how purposeful assessment design can provide insight into students’ thinking by qualitatively examining how students solve performance assessment items using multimodal strategies.
more »
« less
- Award ID(s):
- 1842116
- PAR ID:
- 10351300
- Date Published:
- Journal Name:
- International Conference of the Learning Sciences
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Design projects are an important part of many first-year engineering programs. The desire to employ holistic assessment strategies to student work with open-ended and divergent responses has been widely noted in the literature. Holistic strategies can provide insight into the role of qualities (e.g., professional constructs) that are not typically conducive to standard assessment rubrics. Adaptive Comparative Judgement (ACJ) is an assessment approach that is used to assess design projects holistically. The assessment of projects using ACJ can be carried out by experts or students to scaffold their learning experience. This Work-in-Progress paper explores the use and benefits of ACJ for assessing design projects specifically focusing on first-year engineering students and educators. Further, conference attendees will be provided the opportunity throughout the conference to engage with the ACJ software to experience how this system can work in practice for assessing student design projects.more » « less
-
The mission of the Inclusion Diversity Excellence Achievement (IDEA) Engineering Student Center at UC San Diego’s Jacobs School of Engineering is to promote equity, community, and success for all engineering students at the University from admission through graduation. The Academic Achievement Program (AAP) originally focused on academic performance (i.e., grades) and is evolving to more fully address the myriad of factors that contribute to the overall success of undergraduate engineering students. The AAP aims to promote a culture of care for students’ personal well-being and academic success within engineering courses by providing just-in-time support and reinforcing attitudes and habits that empower students to succeed. This effort can be broken down into three goals: I) promote a multifaceted understanding of factors that influence student success, II) teach learning attitudes and behaviors for effective learning, and III) provide tools to support proactive advising at the classroom level. To reach these goals, we envision instructional teams (typically made up of faculty and teaching assistants) who have the knowledge and tools to proactively provide students with support based on deep understanding of how factors inside and outside the classroom influence learning. Such instructional teams can more effectively improve the learning experience and student outcomes like persistence. We also envision students with attitudes and habits that help them learn effectively and use supporting resources to overcome any challenges they encounter. To achieve these goals, AAP includes three components at various stages of development, implementation, and assessment: 1) the Engineer Your Success Course for undergraduates, 2) Student Support Planning Checklist and community of practice for instructional teams, and 3) content on effective learning strategies for instructional teams. This paper will present a developing conceptual framework that guides these activities, describe each component, present preliminary findings, and discuss potential next steps.more » « less
-
null (Ed.)Strategies are an important component of self-regulated learning frameworks. However, the characterization of strategies in these frameworks is often incomplete: (1) they lack an operational definition of strategies; (2) there is limited understanding of how students develop and apply strategies; and (3) there is a dearth of systematic and generalizable approaches to measure and evaluate strategies when students’ work in open-ended learning environments (OELEs). This paper develops systematic methods for detecting, interpreting, and analyzing students’ use of strategies in OELEs, and demonstrates how students’ strategies evolve across tasks. We apply this framework in the context of tasks that students perform as they learn science topics by building conceptual and computational models in an OELE. Data from a classroom study, where sixth-grade students (N = 52) worked on science model-building activities in our Computational Thinking using Simulation and Modeling (CTSiM) environment demonstrates how we interpret students’ strategy use, and how strategy use relates to their learning performance. We also demonstrate how students’ strategies evolve as they work on multiple model-building tasks. The results demonstrate the effectiveness of our strategy framework in analyzing students’ behaviors and performance in CTSiM.more » « less
-
In response to reform efforts to center students’ interest and identity in the context of assessment, we pilot tested a set of three-dimensional, phenomenon-driven assessment tasks and asked students to respond to additional items that prompted them to reflect on their experience with the tasks. Using a qualitative approach, we analyzed written responses from 502 middle school students across the United States. Through inductive and deductive coding, we developed a comprehensive framework that captures students' experiences across five dimensions: cognitive engagement, affective engagement, relevance to students’ lives, beyond-classroom connections, and assessment design and features. By exploring these dimensions, the framework aims to provide a comprehensive lens for understanding how students experience science assessments, revealing key insights into the factors that influence their engagement and learning. Ultimately, this framework can serve as a practical tool for educators and researchers to analyze and improve science assessments by centering students' voices, thereby fostering deeper learning, promoting student agency, and supporting all learners.more » « less
An official website of the United States government

