skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on August 6, 2025

Title: Investigating a Novel Approach to Assessing Vocabulary Knowledge
This study explored an alternative approach to assessing individuals’ word knowledge by gauging the ability to recognize subtle similarities and differences among associated terms. Informed by the theoretical and empirical work on relational reasoning, the Measure of Vocabulary Knowledge through Relational Reasoning (MVKR2) was developed and validated. Participants were 338 college students who completed the MVKR2, the Test of Relational Reasoning (TORR), and released items from the SAT Verbal and Math tests. The TORR and SAT tests were administered to examine the convergent and concurrent validities of the MVKR2. Findings from item confirmatory analyses and correlations demonstrated that the MVKR2 is a reliable and valid measure of vocabulary knowledge for college-age students. In addition, fluid relational reasoning ability was associated with the performance on this novel measure, but the association with vocabulary knowledge was stronger. When examined on the scale and item levels, the contribution of fluid relational reasoning varied across scales and items within each scale. This study offered an alternative way to examine vocabulary knowledge that has implications for future empirical research and instructional practice.  more » « less
Award ID(s):
2327398
PAR ID:
10536252
Author(s) / Creator(s):
;
Publisher / Repository:
The Journal of Experimental Education
Date Published:
Journal Name:
The Journal of Experimental Education
ISSN:
0022-0973
Page Range / eLocation ID:
1 to 24
Subject(s) / Keyword(s):
vocabulary assessment relational reasoning college students measurement
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The authors completed a pilot study to examine the original Student Support Needs Scale (SSNS') and alternative forms. They assessed how the items were related to each other, how SSNS versions correlated with each other, and the SSNS versions associations with measures of student attitudes and performance. Eighty students from a historically Black college and university participated. SSNS 10-item- and 5-item-per-scale form s were created. They were compared with the original, to each other, and to other measures. The coefficients related to how items related to each other indicated that the alternative form s had similar to better correspondence between related items than the original scales. The 5-item-per-scale version was used as the augmented SSNS (SSNS-A). SSNS-A correlations with measures o f student attitudes and performance were generally in the expected direction. Implications are discussed in regard to reliability and validity of the SSNS-A. 
    more » « less
  2. Various forms of relational processing have been linked to cognitive capacity measures, such as working memory and fluid intelligence. However, previous work has not established the extent to which different forms of relational processing reflect common factors, nor whether individual differences in cognitive style also contribute to variations in relational reasoning. The current study took an individual-differences approach to investigate the prerequisites for relational processing. In two studies, college students completed a battery of standardized tests of individual differences related to fluid intelligence and cognitive style, as well as a series of experimental tasks that require relational reasoning. Moderate correlations were obtained between relational processing and measures of cognitive capacity. Questionnaire measures of cognitive style generally did not improve predictions of relational processing beyond the influence of measures of cognitive capacity. 
    more » « less
  3. This study describes the development and initial validation of a mathematics-specific spatial vocabulary measure for upper elementary school students. Reviews of spatial vocabulary items, mathematics textbooks, and Mathematics Common Core State Standards identified 720 mathematical terms, 148 of which had spatial content (e.g., edge). In total, 29 of these items were appropriate for elementary students, and a pilot study (59 fourth graders) indicated that nine of them were too difficult (< 50% correct) or too easy (> 95% correct). The remaining 20 items were retained as a spatial vocabulary measure and administered to 181 (75 girls, mean age = 119.73 months, SD =4.01) fourth graders, along with measures of geometry, arithmetic, spatial abilities, verbal memory span, and mathematics attitudes and anxiety. A Rasch model indicated that all 20 items assessed an underlying spatial vocabulary latent construct. The convergent and discriminant validity of the vocabulary measure was supported by stronger correlations with theoretically related (i.e., geometry) than with more distantly related (i.e., arithmetic) mathematics content and stronger relations with spatial abilities than with verbal memory span or mathematics attitudes and anxiety. Simultaneous regression analyses and structural equation models, including all measures, confirmed this pattern, whereby spatial vocabulary was predicted by geometry knowledge and spatial abilities but not by verbal memory span, mathematics attitudes and anxiety. Thus, the measure developed in this study helps in assessing upper elementary students' mathematics-specific spatial vocabulary. 
    more » « less
  4. Abstract Despite the importance of developing elementary science teachers' content knowledge for teaching (CKT), there are limited assessments that have been designed to measure the full breadth of their CKT at scale. Our overall research project addressed this gap by developing an online assessment to measure elementary preservice teachers' CKT about matter and its interactions. This study, which was part of our larger project, reports on findings from one component of the item development process examining the construct validity of 118 different CKT about matter assessment items. In this study, 86 elementary teachers participated in cognitive interviews to examine: (a) the knowledge and reasoning they used when responding to these CKT about matter assessment items and (b) the nature of the content challenges and the content teaching challenges they encountered. Findings showed that over 80% of participant interview responses indicated that the CKT about matter items functioned as hypothesized, providing evidence to support future use of these items on a large‐scale assessment and in studies of science teachers' CKT. When responding to the items, participants showed evidence of four main challenges with the science content: (a) using scientific concepts to reason about science tasks, (b) using adequate evidence to reason about science phenomenon, (c) drawing upon examples of scientific phenomena, and (d) drawing upon science vocabulary. Findings also showed that participants experienced challenges regarding the following content teaching aspects when responding to these items: (a) connecting to key scientific concepts involved in the work of teaching science, (b) attending to instructional goal(s), and (c) recognizing features of grade‐level appropriateness. Implications for using CKT items as part of large‐scale science assessment systems and identifying areas to target in elementary science teachers' CKT development are addressed. 
    more » « less
  5. Objective: Research demonstrates that college educated, English language dominant bilinguals underperform relative to English speaking monolinguals on tests of verbal ability. We investigated whether accepting responses in their two languages would reveal improved performance in bilinguals, and whether such improvement would be of sufficient magnitude to demonstrate the same performance level as monolinguals. Method: Participants were college students attending the same university. Spanish-English bilinguals were compared to English speaking monolinguals on the Bilingual Verbal Ability Tests (BVAT), which include Picture Vocabulary, Oral Vocabulary, and Verbal Analogies. Results: When given the opportunity to respond in Spanish to items failed in English, bilinguals obtained significantly higher scores on all three subtests, and their performance matched that of monolinguals on Oral Vocabulary and Verbal Analogies. Conclusion: An “either-language” scoring approach may enable optimal measurement of verbal abilities in bilinguals. We provide normative data for use in applying the either-language scoring approach on subtests of the BVAT. We discuss the findings in the context of clinical assessment. 
    more » « less