skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
Attention:The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 7:00 AM ET to 7:30 AM ET on Friday, April 24 due to maintenance. We apologize for the inconvenience.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes
Title: Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes
The Algebra Concept Inventory (ACI) is the first large-scale instrument validated to measure the foundational algebraic conceptual understanding of college students. This study uses ACI scores to conduct the first quantitative analysis on the relationship between algebraic conceptual understanding and college outcomes, thus exploring the predictive validity of the ACI. Specifically, we investigate whether ACI scores predict: (1) math course grades; (2) subsequent completion of math courses required for STEM majors; (3) completion of STEM versus non-STEM degrees; and (4) the extent that differences in these outcomes by race/ethnicity or gender are explained by ACI scores. Results indicate that ACI scores significantly predict math course outcomes and STEM versus non-STEM degree completion, as well as significant proportions of differences in these outcomes by race/ethnicity and gender. This illustrates the importance of providing every student instruction that supports development of the kinds of foundational algebraic conceptual understanding measured by the ACI.  more » « less
Award ID(s):
1760491
PAR ID:
10673552
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
AERA Open
Date Published:
Journal Name:
AERA open
Volume:
12
Issue:
1
ISSN:
2332-8584
Page Range / eLocation ID:
1-30
Subject(s) / Keyword(s):
higher education, colleges, assessment, equity, mathematics education, hierarchical linear modeling, regression analyses, research in undergraduate mathematics education, concept inventories, algebra, conceptual understanding, predictive validity, STEM majors
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; (, AERA)
    Algebraic conceptual understanding is a critical mathematical skill. However, until recently, larger-scale validated assessments in algebra consisted mostly of computational tasks, or only assessed a narrow range of conceptions in a focused domain. Moreover, few instruments had been validated for college students. In this paper, we explore the predictive validity of the recently-validated Algebra Concept Inventory (ACI); in particular, whether college students’ ACI scores predict math course grades, STEM-major math course completion, and STEM vs. non-STEM degree attainment. We also explore whether the ACI score explains outcome differences by race/ethnicity/gender. 
    more » « less
  2. ; ; ; ; ; ; ; (, Proceedings of the 27th Annual Conference on Research in Undergraduate Mathematics Education. (pp. 328–337). SIGMAA on RUME.)
    Cook, S; Katz, BP; Melhuish, K (Ed.)
    Algebra has been found to be a barrier to college and STEM-major completion, and a contributing factor to unequal access to STEM fields. Conceptual understanding has often been discussed as an important component of mathematics learning; yet more marginalized students often have less access to rich mathematics instruction and to algebra learning opportunities. However, to date no research has investigated the relationship between conceptual understanding and math or STEM outcomes in college. In this research, we explore the predictive validity of the recently validated Algebra Concept Inventory (ACI) to determine whether college students’ ACI scores predict math course grades, STEM-major math course completion, and STEM vs. non-STEM degree attainment as well as whether ACI score explains outcome differences by race/ethnicity/gender. 
    more » « less
  3. ; ; ; ; ; ; ; (, Proceedings of the 2025 Joint Mathematics Meetings (JMM))
    Algebraic conceptual understanding is a critical mathematical skill. However, until recently, larger-scale validated assessments in algebra consisted mostly of computational tasks, or only assessed a narrow range of conceptions in a focused domain. Moreover, few instruments had been validated for college students. In this research, we explore the predictive validity of the recently-validated Algebra Concept Inventory (ACI); in particular, whether college students’ ACI scores predict math course grades, STEM-major math course completion, and STEM vs. non-STEM degree attainment. We also explore whether the ACI score explains outcome differences by race/ethnicity/gender. The ACI was designed to assess student conceptions of core mathematics concepts that are critical for algebra, such as variable, equivalence, and function. Items were designed to be accessible to students with all levels of algebra experience, starting with students who have taken or are currently enrolled in elementary algebra in college (or who have prior experience with Algebra I in secondary school). Data for students enrolled in any mathematics course at or above elementary algebra at the largest community college at the City University of New York (CUNY) were collected and merged with an existing dataset of ACI scores (based on 2pl IRT models). Regression as well as mediation analysis using the KHB method were used in order to explore predictive relationships between ACI score and subsequent academic outcomes. On average, one standard deviation (SD) increase in ACI score correlated with a 0.4 increase in grade points for a student’s enrolled mathematics course. ACI scores also significantly predicted whether a student would complete each of the five core STEM major mathematics requirements, given their current course level. For every one SD increase in ACI score, students were also 5.1 percentage points more likely to complete a STEM vs. non-STEM degree when controlling for current course level. ACI score predicted STEM degree completion more strongly than course grade alone. ACI scores also explained a significant portion of differences in math course grade by race/ethnicity, illustrating the importance of instruction in algebraic conceptual understanding for equitable learning and course outcomes. 
    more » « less
  4. ; ; (, Proceedings of the 14th Congress of the European Society for Research in Mathematics Education (CERME14))
    We explore whether outcomes in tertiary mathematics courses and STEM (science, technology, engineering and mathematics) degrees can be predicted by scores on the previously-validated Algebra Concept Inventory (ACI). We also explore whether ACI scores explain gaps in outcomes by race/ethnicity and gender. This research explores a dataset of 6,582 students enrolled at the City University of New York, a diverse, urban, public university in the U.S. Results suggest that ACI scores can significantly predict tertiary math and STEM outcomes, above and beyond math course grades. 
    more » « less
  5. ; ; ; ; (, Proceedings of the 47th Conference of the International Group for the Psychology of Mathematics Education)
    Evans, T; Marmur, O; Hunter, J; Leach, G (Ed.)
    In college, taking algebra can prevent degree completion. One reason for this is that algebra courses in college tend to focus on procedures disconnected from meaning-making (e.g., Goldrick-Rab, 2007). It is critical to connect procedural fluency with conceptual understanding (Kilpatrick, et al., 2001). Several instruments test algebraic proficiency, however, none were designed to test a large body of algebraic conceptions and concepts. We address this gap by developing the Algebra Concept Inventory (ACI), to test college students’ conceptual understanding in algebra. A total of 402 items were developed and tested in eight waves from spring 2019 to fall 2022, administered to 18,234 students enrolled in non-arithmetic based mathematics classes at a large urban community college in the US. Data collection followed a common-item random groups equating design. Retrospective think-aloud interviews were conducted with 135 students to assess construct validity of the items. 2PL IRT models were run on all waves; 63.4% of items (253) have at least moderate, and roughly one-third have high or very high discrimination. In all waves, peak instrument values have excellent reliability ( R ≥ 0.9 ). Convergent validity was explored through the relationship between scores on the ACI and mathematics course level. Students in “mid”-level courses scored on average 0.35 SD higher than those in “low”-level courses; students in “high”-level courses scored on average 0.35 SD higher than those in “mid”-level courses, providing strong evidence of convergent validity. There was no consistent evidence of differential item functioning (DIF) related to examinee characteristics: race/ethnicity, gender, and English-language-learner status. Results suggest that algebraic conceptual understanding, conceptualized by the ACI, is measurable. The final ACI is likely to differentiate between students of various mathematical levels, without conflating characteristics such as race, gender, etc. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Text Encoded Conversion
  • XML
  • Save / Share this Record
  • Send to Email