skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: A Validity Argument for a Brief Assessment of Mature Number Sense
This Brief Report presents an example of assessment validation using an argument-based approach. The instrument we developed is a Brief Assessment of Students’ Mature Number Sense, which measures a central goal in mathematics education. We chose to develop this assessment to provide an efficient way to measure the effect of instructional practices designed to improve students’ number sense. Using an argument-based framework, we first identify our proposed interpretations and uses of student scores. We then outline our argument with three claims that provide evidence connecting students’ responses on the assessment with its intended uses. Finally, we highlight why using argument-based validation benefits measure developers as well as the broader mathematics education community.  more » « less
Award ID(s):
2100214
PAR ID:
10499941
Author(s) / Creator(s):
; ;
Publisher / Repository:
National Council of Teachers of Mathematics
Date Published:
Journal Name:
Journal for Research in Mathematics Education
Volume:
55
Issue:
1
ISSN:
0021-8251
Page Range / eLocation ID:
51 to 67
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Journal of Numerical Cognition)
    Students who exhibit mature number sense make sense of numbers and operations, use reasoning to notice patterns, and flexibly choose effective problem-solving strategies (McIntosh et al., 1997, https://ro.ecu.edu.au/ecuworks/6819). Due to its dispositional nature, mature number sense is typically measured through in-depth interviews or tests of strategy usage. Yet, the lack of an efficient, rigorously developed measure has made it difficult to collect systematic, replicable evidence on students’ mature number sense. To address this, we developed a brief assessment of mature number sense. The present study provides additional convergent evidence of validity for this measure with US students in grades 3-8 (8–14 years old). We compared middle school (N = 40) and upper elementary school (N = 41) scores from the brief assessment with an established, time-intensive measure (Yang, 2019, https://doi.org/10.1007/s10649-018-9874-8) and an in-depth interview of student strategy usage (Markovits & Sowder, 1994, https://doi.org/10.2307/749290). We found strong correlations (r > 0.7) across all three measures, and this held even when controlling for students’ arithmetic scores (pr > 0.6). Researchers and educators can now use the brief assessment to investigate students’ mathematical thinking and advance knowledge of a key aspect of mathematical cognition. 
    more » « less
  2. (, Proceedings of the 46th Annual Meeting of the Research Council on Mathematics Learning)
    Validity-related issues are a growing topic within the mathematics education community. Until recently, validation has been treated as something to gather when convenient or is rarely reported in ways that conform to current standards for assessment development. This theoretically-focused proceeding adds to a burgeoning theoretical argument that validation should be considered a methodology within mathematics education scholarship. We connect to design-science research, which is a well-established framework within mathematics education. The goal for this proceeding is to foster the conversation about validation using examples and to communicate information about validation in ways that are broadly accessible. 
    more » « less
  3. ; ; (, Practical assessment research evaluation)
    The early development of spatial reasoning skills has been linked to future success in mathematics (Wai, Lubinski, & Benbow, 2009), but research to date has mainly focused on the development of these skills within classroom settings rather than at home. The home environment is often the first place students are exposed to, and develop, early mathematics skills, including spatial reasoning (Blevins-Knabe, 2016; Hart, Ganley, & Purpura, 2016). The purpose of the current study is to develop a survey instrument to better understand Kindergarten through Grade 2 students’ opportunities to learn spatial reasoning skills at home. Using an argument-based approach to validation (Kane, 2013), we collected multiple sources of validity evidence, including expert review of item wording and content and pilot data from 201 parent respondents. This manuscript outlines the interpretation/use argument that guides our validation study and presents evidence collected to evaluate the scoring inferences for using the survey to measure students’ opportunities to learn spatial reasoning skills at home. 
    more » « less
  4. ; ; ; ; ; (, Research Council on Mathematics Learning)
    Kombe, Dennis; Wheeler, Ann (Ed.)
    The purpose of this proceeding is to share a component to a validity argument for a new, computer adaptive mathematics Problem-Solving Measure that is designed for grades six through eight (PSM 6-8). The PSM is a single test, which uses computer adaptive features to measure students’ performance using instructional standards. It is intended to measure students’ problem-solving performance related to instructional standards. 
    more » « less
  5. ; ; ; ; ; ; (, American Association of Physics Teachers)
    Physics instructors and education researchers use research-based assessments (RBAs) to evaluate students' preparation for physics courses. This preparation can cover a wide range of constructs including mathematics and physics content. Using separate mathematics and physics RBAs consumes course time. We are developing a new RBA for introductory mechanics as an online test using both computerized adaptive testing and cognitive diagnostic models. This design allows the adaptive RBA to assess mathematics and physics content knowledge within a single assessment. In this article, we used an evidence-centered design framework to inform the extent to which our models of skills students develop in physics courses fit the data from three mathematics RBAs. Our dataset came from the LASSO platform and includes 3,491 responses from the Calculus Concept Assessment, Calculus Concept Inventory, and Pre-calculus Concept Assessment. Our model included five skills: apply vectors, conceptual relationships, algebra, visualizations, and calculus. The "deterministic inputs, noisy 'and' gate'' (DINA) analyses demonstrated a good fit for the five skills. The classification accuracies for the skills were satisfactory. Including items from the three mathematics RBAs in the item bank for the adaptive RBA will provide a flexible assessment of these skills across mathematics and physics content areas that can adapt to instructors' needs. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email