skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Examining the arguments surrounding the argument-based approach to validation: A systematic review of validation methodology
Title: Examining the arguments surrounding the argument-based approach to validation: A systematic review of validation methodology
As early as Descartes (1637/1970), logic and reason have been positioned as tools for individuals to advance their own understanding. By contrast, argumentation is an interactive, social exercise used for persuasion, collective cognition, and to advance shared knowledge (Mercier & Sperber, 2011, 2017). When one advances an argument, subjects it to the tests and challenges of others, and responds to questions and counterarguments, one’s thinking improves (Mercier & Sperber, 2017). Through argumentation, groups produce correct solutions more often than individuals (Moshman & Geil, 1998) and individual accuracy improves as well (Castelain, Girotto, Jamet, & Mercier, 2016). Since it was formally introduced by Kane (1990, 1992), the argument-based approach to validation has been promoted in the field of educational and psychological measurement as the preferred method for validating interpretations and uses of test scores (AERA, APA, & NCME, 2014; Kane, 2013; Schilling & Hill, 2007). Scholars continue to debate the best approaches for developing and supporting validity arguments, however (for examples, see Brennan, 2013; Kane, 2007).  more » « less
Award ID(s):
1644314
PAR ID:
10064697
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
American Educational Research Association
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Practical assessment research evaluation)
    The early development of spatial reasoning skills has been linked to future success in mathematics (Wai, Lubinski, & Benbow, 2009), but research to date has mainly focused on the development of these skills within classroom settings rather than at home. The home environment is often the first place students are exposed to, and develop, early mathematics skills, including spatial reasoning (Blevins-Knabe, 2016; Hart, Ganley, & Purpura, 2016). The purpose of the current study is to develop a survey instrument to better understand Kindergarten through Grade 2 students’ opportunities to learn spatial reasoning skills at home. Using an argument-based approach to validation (Kane, 2013), we collected multiple sources of validity evidence, including expert review of item wording and content and pilot data from 201 parent respondents. This manuscript outlines the interpretation/use argument that guides our validation study and presents evidence collected to evaluate the scoring inferences for using the survey to measure students’ opportunities to learn spatial reasoning skills at home. 
    more » « less
  2. ; ; ; (, Northern Rocky Mountain Educational Research Association)
    Hidden curriculum (HC) consist of the particular assumptions that are held by individuals about schooling that are manifested in practice (Smith, 2014). These assumptions can be recognized through socio cultural interactions, experiences with their physical surroundings, or exposure to virtual environments (The Glossary of Education Reform, 2017; Killick , 2016; Margolis, 2001; Smith, 2014). HC has been explored widely in fields such as education, psychology, business, and medicine (Baird, Bracken, & Grierson, 2016; Borges, Ferreira, Borges de Oliveria , Macini , Caldana , 2017; Cotton, Winter, & Bailey, 2013; Joughin , 2010; Margolis, 2001; Rabah , 2012; Smith, 2014) but is relatively unaddressed in engineering (Erickson, 2007; Villanueva et al., 2018) and more specifically neither the positive or negative implications of HC in engineering have been explored. This study sought to use a mixed method approach to understand the mechanisms behind HC recognition (via emotions and self efficacy) for engineering students and faculty nationwide. 
    more » « less
  3. ; ; (, Proceedings of the forty-third annual meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education)
    Olanoff, D.; Johnson, K.; Spitzer, S. M. (Ed.)
    Argumentation is widely used in teaching mathematics, but little research has been done on argumentation in teaching integrated mathematics and coding. As part of a larger study investigating collective argumentation in teaching mathematics, science, and coding, we classified the warrants given by elementary-age students who were engaged in argumentation in mathematics and coding. Three ma}or categories - calculation, visual, and unformalized knowledge - accounted for the majority of warrants given. Further analysis revealed differences in types of warrants when the primary focus of the argument was coding versus when the primary focus of the argument was mathematics. Our results suggest that expecting students to provide reasons for modifying their code, similar to what is expected in mathematics arguments, helps move them away from a trial-and-error to a more structured approach to coding. 
    more » « less
  4. ; (, Proceedings of SemEval-2023 Task 4)
    The subtle human values we acquire through life experiences govern our thoughts and gets reflected in our speech. It plays an integral part in capturing the essence of our individuality and making it imperative to identify such values in computational systems that mimic human actions. Computational argumentation is a field that deals with the argumentation capabilities of humans and can benefit from identifying such values. Motivated by that, we present an ensemble approach for detecting human values from argument text. Our ensemble comprises three models: (i) An entailment-based model for determining the human values based on their descriptions, (ii) A Roberta-based classifier that predicts the set of human values from an argument. (iii) A Roberta-based classifier to predict a reduced set of human values from an argument. We experiment with different ways of combining the models and report our results. Furthermore, our best combination achieves an overall F1 score of 0.48 on the main test set. 
    more » « less
  5. ; ; (, Antipode)
    Abstract Tracing the development of Lehman Brothers from their roots as a dry goods store in Montgomery, Alabama, into a Fortune 500 global financial services company that collapsed in the 2007 financial crisis reveals the contours of US‐style racial capitalism. We highlight how race and capital are geographically rooted in the United States. At the heart of our argument is an understanding of the geographic imperative of capital which creates and exploits differences to wrench capital’s profits from the blood, sweat, and toil of racialised bodies. Perhaps most geographically significant, we advance a second, interrelated argument, the geographic case for reparations. By arguing the system itself is entirely and wholly wrapped in race in ways that extend and advance practices of exploitation, we understand reparations that do not fundamentally undermine, transform, destabilise or smash the system as doomed to be short‐term solutions to long‐term structural problems. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email