An official website of the United States government
Algorithmic bias research often evaluates models in terms of traditional demographic categories (e.g., U.S. Census), but these categories may not capture nuanced, context-dependent identities relevant to learning. This study evaluates four affect detectors (boredom, confusion, engaged concentration, and frustration) developed for an adaptive math learning system. Metrics for algorithmic fairness (AUC, weighted F1, MADD) show subgroup differences across several categories that emerged from a free-response social identity survey (Twenty Statements Test; TST), including both those that mirror demographic categories (i.e., race and gender) as well as novel categories (i.e., Learner Identity, Interpersonal Style, and Sense of Competence). For demographic categories, the confusion detector performs better for boys than for girls and underperforms for West African students. Among novel categories, biases are found related to learner identity (boredom, engaged concentration, and confusion) and interpersonal style (confusion), but not for sense of competence. Results highlight the importance of using contextually grounded social identities to evaluate bias.
more »
« less
This content will become publicly available on July 21, 2026
Exploring Student Identity in Adaptive Learning Systems Through Qualitative Data
Adaptive learning systems are increasingly common in U.S. classrooms, but it is not yet clear whether their positive impacts are realized equally across all students. This study explores whether nuanced identity categories from open-ended self-reported data are associated with outcomes in an adaptive learning system for secondary mathematics. As a measure of impact of these social identity data, we correlate student responses for 3 categories: race and ethnicity, gender, and learning identity—a category combining student status and orientation toward learning—and total lessons completed in an adaptive learning system over one academic year. Results show the value of emergent and novel identity categories when measuring student outcomes, as learning identity was positively correlated with mathematics outcomes across two statistical tests.
more »
« less
- PAR ID:
- 10658122
- Publisher / Repository:
- Springer Nature Switzerland
- Date Published:
- Page Range / eLocation ID:
- 356 to 363
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Walker, WS; Bryan, L A; Guzey, SS (Ed.)The Thinking With Algebra (TWA) curriculum, a National Science Foundation Project (DUE 2021414), applies a sociopolitical equity framework (Gutiérrez, 2012) to strengthen student participants’ mathematics achievement outcomes and mathematics identity development. Instructor and student data indicate improvements in these two dimensions. This project also expands knowledge about creating equitable math learning environments that support underrepresented students’ mathematical success.more » « less
-
In the United States (US) and elsewhere across the world, undergraduate mathematics instructors are increasingly aware of the value of inquiry-based instruction. In this research commentary, we describe the intellectual origins and development of two major strands of inquiry in US higher education, offer an explanation for apparent differences in these strands, and argue that they be united under a common vision of Inquiry-Based Mathematics Education (IBME). Central to this common vision are four pillars of IBME: student engagement in meaningful mathematics, student collaboration for sensemaking, instructor inquiry into student thinking, and equitable instructional practice to include all in rigorous mathematical learning and mathematical identity building. We conclude this commentary with a call for a four-pronged agenda for research and practice focused on learning trajectories, transferable skills, equity, and a systems approach.more » « less
-
Education researchers often compare performance across race and gender on research-based assessments of physics knowledge to investigate the impacts of racism and sexism on physics student learning. These investigations' claims rely on research-based assessments providing reliable, unbiased measures of student knowledge across social identity groups. We used classical test theory and differential item functioning (DIF) analysis to examine whether the items on the Force Concept Inventory (FCI) provided unbiased data across social identifiers for race, gender, and their intersections. The data was accessed through the Learning About STEM Student Outcomes platform and included responses from 4,848 students posttests in 152 calculus-based introductory physics courses from 16 institutions. The results indicated that the majority of items (22) on the FCI were biased towards a group. These results point to the need for instrument validation to account for item bias and the identification or development of fair research-based assessments.more » « less
-
Using archived student data for middle and high school students’ mathematics-focused intelligent tutoring system (ITS) learning collected across a school year, this study explores situational, achievement-goal latent profile membership and the stability of these profiles with respect to student demographics and dispositional achievement goal scores. Over 65% of students changed situational profile membership at some time during the school year. Start-of-year dispositional motivation scores were not related to whether students remained in the same profile across all unit-level measurements. Grade level was predictive of profile stability. Findings from the present study should shed light on how in-the-moment student motivation fluctuates while students are engaged in ITS math learning. Present findings have potential to inform motivation interventions designed for ITS math learning.more » « less
