skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, February 13 until 2:00 AM ET on Friday, February 14 due to maintenance. We apologize for the inconvenience.


Title: Examining the Relationship Between Multiple Tests of Receptive Vocabulary
Purpose:

Numerous tasks have been developed to measure receptive vocabulary, many of which were designed to be administered in person with a trained researcher or clinician. The purpose of the current study is to compare a common, in-person test of vocabulary with other vocabulary assessments that can be self-administered.

Method:

Fifty-three participants completed the Peabody Picture Vocabulary Test (PPVT) via online video call to mimic in-person administration, as well as four additional fully automated, self-administered measures of receptive vocabulary. Participants also completed three control tasks that do not measure receptive vocabulary.

Results:

Pearson correlations indicated moderate correlations among most of the receptive vocabulary measures (approximatelyr= .50–.70). As expected, the control tasks revealed only weak correlations to the vocabulary measures. However, subsets of items of the four self-administered measures of receptive vocabulary achieved high correlations with the PPVT (r> .80). These subsets were found through a repeated resampling approach.

Conclusions:

Measures of receptive vocabulary differ in which items are included and in the assessment task (e.g., lexical decision, picture matching, synonym matching). The results of the current study suggest that several self-administered tasks are able to achieve high correlations with the PPVT when a subset of items are scored, rather than the full set of items. These data provide evidence that subsets of items on one behavioral assessment can more highly correlate to another measure. In practical terms, these data demonstrate that self-administered, automated measures of receptive vocabulary can be used as reasonable substitutes of at least one test (PPVT) that requires human interaction. That several of the fully automated measures resulted in high correlations with the PPVT suggests that different tasks could be selected depending on the needs of the researcher. It is important to note the aim was not to establish clinical relevance of these measures, but establish whether researchers could use an experimental task of receptive vocabulary that probes a similar construct to what is captured by the PPVT, and use these measures of individual differences.

 
more » « less
Award ID(s):
2020805
PAR ID:
10530864
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Journal of Speech, Language, and Hearing Research
Date Published:
Journal Name:
Journal of Speech, Language, and Hearing Research
Volume:
67
Issue:
2
ISSN:
1092-4388
Page Range / eLocation ID:
595 to 605
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This study explored an alternative approach to assessing individuals’ word knowledge by gauging the ability to recognize subtle similarities and differences among associated terms. Informed by the theoretical and empirical work on relational reasoning, the Measure of Vocabulary Knowledge through Relational Reasoning (MVKR2) was developed and validated. Participants were 338 college students who completed the MVKR2, the Test of Relational Reasoning (TORR), and released items from the SAT Verbal and Math tests. The TORR and SAT tests were administered to examine the convergent and concurrent validities of the MVKR2. Findings from item confirmatory analyses and correlations demonstrated that the MVKR2 is a reliable and valid measure of vocabulary knowledge for college-age students. In addition, fluid relational reasoning ability was associated with the performance on this novel measure, but the association with vocabulary knowledge was stronger. When examined on the scale and item levels, the contribution of fluid relational reasoning varied across scales and items within each scale. This study offered an alternative way to examine vocabulary knowledge that has implications for future empirical research and instructional practice. 
    more » « less
  2. Abstract

    Numeracy—the ability to understand and use numeric information—is linked to good decision-making. Several problems exist with current numeracy measures, however. Depending on the participant sample, some existing measures are too easy or too hard; also, established measures often contain items well-known to participants. The current article aimed to develop new numeric understanding measures (NUMs) including a 1-item (1-NUM), 4-item (4-NUM), and 4-item adaptive measure (A-NUM). In a calibration study, 2 participant samples (n = 226 and 264 from Amazon’s Mechanical Turk [MTurk]) each responded to half of 84 novel numeracy items. We calibrated items using 2-parameter logistic item response theory (IRT) models. Based on item parameters, we developed the 3 new numeracy measures. In a subsequent validation study, 600 MTurk participants completed the new numeracy measures, the adaptive Berlin Numeracy Test, and the Weller Rasch-Based Numeracy Test, in randomized order. To establish predictive and convergent validities, participants also completed judgment and decision tasks, Raven’s progressive matrices, a vocabulary test, and demographics. Confirmatory factor analyses suggested that the 1-NUM, 4-NUM, and A-NUM load onto the same factor as existing measures. The NUM scales also showed similar association patterns to subjective numeracy and cognitive ability measures as established measures. Finally, they effectively predicted classic numeracy effects. In fact, based on power analyses, the A-NUM and 4-NUM appeared to confer more power to detect effects than existing measures. Thus, using IRT, we developed 3 brief numeracy measures, using novel items and without sacrificing construct scope. The measures can be downloaded as Qualtrics files (https://osf.io/pcegz/).

     
    more » « less
  3. This study describes the development and initial validation of a mathematics-specific spatial vocabulary measure for upper elementary school students. Reviews of spatial vocabulary items, mathematics textbooks, and Mathematics Common Core State Standards identified 720 mathematical terms, 148 of which had spatial content (e.g., edge). In total, 29 of these items were appropriate for elementary students, and a pilot study (59 fourth graders) indicated that nine of them were too difficult (< 50% correct) or too easy (> 95% correct). The remaining 20 items were retained as a spatial vocabulary measure and administered to 181 (75 girls, mean age = 119.73 months, SD =4.01) fourth graders, along with measures of geometry, arithmetic, spatial abilities, verbal memory span, and mathematics attitudes and anxiety. A Rasch model indicated that all 20 items assessed an underlying spatial vocabulary latent construct. The convergent and discriminant validity of the vocabulary measure was supported by stronger correlations with theoretically related (i.e., geometry) than with more distantly related (i.e., arithmetic) mathematics content and stronger relations with spatial abilities than with verbal memory span or mathematics attitudes and anxiety. Simultaneous regression analyses and structural equation models, including all measures, confirmed this pattern, whereby spatial vocabulary was predicted by geometry knowledge and spatial abilities but not by verbal memory span, mathematics attitudes and anxiety. Thus, the measure developed in this study helps in assessing upper elementary students' mathematics-specific spatial vocabulary.

     
    more » « less
  4. Abstract Introduction

    Working memory is a critical cognitive ability that affects our daily functioning and relates to many cognitive processes and clinical conditions. Episodic memory is vital because it enables individuals to form and maintain their self‐identities. Our study analyzes the extent to which whole‐brain functional connectivity observed during completion of anN‐back memory task, a common measure of working memory, can predict both working memory and episodic memory.

    Methods

    We used connectome‐based predictive models (CPMs) to predict 502 Human Connectome Project (HCP) participants' in‐scanner 2‐back memory test scores and out‐of‐scanner working memory test (List Sorting) and episodic memory test (Picture Sequence and Penn Word) scores based on functional magnetic resonance imaging (fMRI) data collected both during rest andN‐back task performance. We also analyzed the functional brain connections that contributed to prediction for each of these models.

    Results

    Functional connectivity observed duringN‐back task performance predicted out‐of‐scanner List Sorting scores and to a lesser extent out‐of‐scanner Picture Sequence scores, but did not predict out‐of‐scanner Penn Word scores. Additionally, the functional connections predicting 2‐back scores overlapped to a greater degree with those predicting List Sorting scores than with those predicting Picture Sequence or Penn Word scores. Functional connections with the insula, including connections between insular and parietal regions, predicted scores across the 2‐back, List Sorting, and Picture Sequence tasks.

    Conclusions

    Our findings validate functional connectivity observed during theN‐back task as a measure of working memory, which generalizes to predict episodic memory to a lesser extent. By building on our understanding of the predictive power ofN‐back task functional connectivity, this work enhances our knowledge of relationships between working memory and episodic memory.

     
    more » « less
  5. null (Ed.)
    Purpose The extant literature suggests that individual differences in speech perception can be linked to broad receptive language phenotype. For example, a recent study found that individuals with a smaller receptive vocabulary showed diminished lexically guided perceptual learning compared to individuals with a larger receptive vocabulary. Here, we examined (a) whether such individual differences stem from variation in reliance on lexical information or variation in perceptual learning itself and (b) whether a relationship exists between lexical recruitment and lexically guided perceptual learning more broadly, as predicted by current models of lexically guided perceptual learning. Method In Experiment 1, adult participants ( n = 70) completed measures of receptive and expressive language ability, lexical recruitment, and lexically guided perceptual learning. In Experiment 2, adult participants ( n = 120) completed the same lexical recruitment and lexically guided perceptual learning tasks to provide a high-powered replication of the primary findings from Experiment 1. Results In Experiment 1, individuals with weaker receptive language ability showed increased lexical recruitment relative to individuals with higher receptive language ability; however, receptive language ability did not predict the magnitude of lexically guided perceptual learning. Moreover, the results of both experiments converged to show no evidence indicating a relationship between lexical recruitment and lexically guided perceptual learning. Conclusion The current findings suggest that (a) individuals with weaker language ability demonstrate increased reliance on lexical information for speech perception compared to those with stronger receptive language ability; (b) individuals with weaker language ability maintain an intact perceptual learning mechanism; and, (c) to the degree that the measures used here accurately capture individual differences in lexical recruitment and lexically guided perceptual learning, there is no graded relationship between these two constructs. 
    more » « less