skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: On the Need to Improve the Way Individual Differences in Cognitive Function Are Measured With Reaction Time Tasks
The measurement of individual differences in specific cognitive functions has been an important area of study for decades. Often the goal of such studies is to determine whether there are cognitive deficits or enhancements associated with, for example, a specific population, psychological disorder, health status, or age group. The inherent difficulty, however, is that most cognitive functions are not directly observable, so researchers rely on indirect measures to infer an individual’s functioning. One of the most common approaches is to use a task that is designed to tap into a specific function and to use behavioral measures, such as reaction times (RTs), to assess performance on that task. Although this approach is widespread, it unfortunately is subject to a problem of reverse inference: Differences in a given cognitive function can be manifest as differences in RTs, but that does not guarantee that differences in RTs imply differences in that cognitive function. We illustrate this inference problem with data from a study on aging and lexical processing, highlighting how RTs can lead to erroneous conclusions about processing. Then we discuss how employing choice-RT models to analyze data can improve inference and highlight practical approaches to improving the models and incorporating them into one’s analysis pipeline.  more » « less
Award ID(s):
1650438
PAR ID:
10390781
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Current Directions in Psychological Science
Volume:
31
Issue:
3
ISSN:
0963-7214
Page Range / eLocation ID:
223 to 230
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. (, Judgment and decision making)
    null (Ed.)
    There are many ways to measure how people manage risk when they make decisions. A standard approach is to measure risk propensity using self-report questionnaires. An alternative approach is to use decision-making tasks that involve risk and uncertainty, and apply cognitive models of task behavior to infer parameters that measure people's risk propensity. We report the results of a within-participants experiment that used three questionnaires and four decision-making tasks. The questionnaires are the Risk Propensity Scale, the Risk Taking Index, and the Domain Specific Risk Taking Scale. The decision-making tasks are the Balloon Analogue Risk Task, the preferential choice gambling task, the optimal stopping problem, and the bandit problem. We analyze the relationships between the risk measures and cognitive parameters using Bayesian inferences about the patterns of correlation, and using a novel cognitive latent variable modeling approach. The results show that people's risk propensity is generally consistent within different conditions for each of the decision-making tasks. There is, however, little evidence that the way people manage risk generalizes across the tasks, or that it corresponds to the questionnaire measures. 
    more » « less
  2. ; ; (, IEEE)
    Identifying spatiotemporal differences in brain functional dynamics corresponding to two tasks is critical for understanding how specific neural processes contribute to distinct tasks or cognitive functions. Traditional methods rely on imposing assumptions and limits on the location and timing of activities, while machine-learning-based methods generally lack offering interpretable insights. This highlights the need for new data-driven approaches to capture spatial and temporal differences in brain activity between two tasks, while also providing interpretable explanations of the neural processes underlying these differences. In this work, we formulate the problem of finding the spatial and temporal differences in the dynamics of brain function corresponding to two motor imagery (MI) tasks (left hand movement vs right hand movement) as a discriminative discrete basis problem (DDBP). We apply the data-driven asymmetric discriminative associative algorithm (ADASSO) to EEG data collected during these tasks to uncover the key functional components of the brain’s functional dynamics that differentiate between them. Results suggest that hand movements are strongly associated with high confidence activation in the motor cortex, verifying the effectiveness of the ADASSO algorithm in identifying the location and timing of cortical activities that distinguish between the two task classes. 
    more » « less
  3. ; ; ; ; ; ; ; ; (, The Journal of the Acoustical Society of America)
    Speech recognition in noisy environments can be challenging and requires listeners to accurately segregate a target speaker from irrelevant background noise. Stochastic figure-ground (SFG) tasks in which temporally coherent inharmonic pure-tones must be identified from a background have been used to probe the non-linguistic auditory stream segregation processes important for speech-in-noise processing. However, little is known about the relationship between performance on SFG tasks and speech-in-noise tasks nor the individual differences that may modulate such relationships. In this study, 37 younger normal-hearing adults performed an SFG task with target figure chords consisting of four, six, eight, or ten temporally coherent tones amongst a background of randomly varying tones. Stimuli were designed to be spectrally and temporally flat. An increased number of temporally coherent tones resulted in higher accuracy and faster reaction times (RTs). For ten target tones, faster RTs were associated with better scores on the Quick Speech-in-Noise task. Individual differences in working memory capacity and self-reported musicianship further modulated these relationships. Overall, results demonstrate that the SFG task could serve as an assessment of auditory stream segregation accuracy and RT that is sensitive to individual differences in cognitive and auditory abilities, even among younger normal-hearing adults. 
    more » « less
  4. ; ; ; ; (, Frontiers in Psychology)
    Although inattention is a key symptom subdomain of attention-deficit/hyperactivity disorder (ADHD), the mechanisms underlying this subdomain and related symptoms remain unclear. There is a need for more granular approaches that allow for greater specificity in linking disruptions in specific domains of cognitive performance (e.g., executive function and reward processing) with behavioral manifestations of ADHD. Such approaches may inform the development of more targeted therapeutic interventions. Here, we describe the results of a pilot study of elementary-aged children (ages 6–12years) with ADHD ( n =50) and typically developing children ( n =48) utilizing a cognitive science task designed to target two dissociable mechanisms of attentional selection: a goal-driven mechanism (i.e., reward/value-driven) and a salience-driven mechanism. Participants were asked to optimally extract and combine information about stimulus salience and value to maximize rewards. While results of this pilot study are ambiguous due to the small sample size and limited number of task trials, data suggest that neither participants with ADHD nor typically developing participants performed optimally to maximize rewards, though typically developing participants were somewhat more successful at the task (i.e., more likely to report high-value targets) regardless of task condition. Further, the manuscript examines several follow-up questions regarding group differences in task response times and group differences in task performance as related to sustained attention across the duration of the task. Finally, the manuscript examines follow-up questions related to heterogeneity in the ADHD group (i.e., age, DSM 5 presentation, and comorbid diagnosis) in predicting task performance. 
    more » « less
  5. ; (, Memory cognition)
    Various forms of relational processing have been linked to cognitive capacity measures, such as working memory and fluid intelligence. However, previous work has not established the extent to which different forms of relational processing reflect common factors, nor whether individual differences in cognitive style also contribute to variations in relational reasoning. The current study took an individual-differences approach to investigate the prerequisites for relational processing. In two studies, college students completed a battery of standardized tests of individual differences related to fluid intelligence and cognitive style, as well as a series of experimental tasks that require relational reasoning. Moderate correlations were obtained between relational processing and measures of cognitive capacity. Questionnaire measures of cognitive style generally did not improve predictions of relational processing beyond the influence of measures of cognitive capacity. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email