skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Does Stimulus Category Coherence Influence Visual Working Memory? A Rational Analysis
Abstract Visual working memory (VWM) refers to the temporary storage and manipulation of visual information. Although visually different, objects we view and remember can share the same higher‐level category information, such as an apple, orange, and banana all being classified as fruit. We study the influence of category information on VWM, focusing on the question of whether stimulus category coherence (i.e., whether all to‐be‐remembered items belong to the same semantic category) influences VWM performance. This question is addressed in two behavioral experiments using a change‐detection paradigm and a rational analysis using an ideal observer based on a Bayesian model. Both experimental participants and the ideal observer often, but not always, performed numerically better on coherent trials (i.e., when all stimuli belonged to the same category). We hypothesize that the influence of category coherence information on VWM may be task‐dependent and/or stimulus‐dependent. In conditions when category coherence information is highly valuable for task performance, as indicated by the ideal observer, then participants tended to make use of it. However, when the ideal observer suggested this information was not crucial to performance, participants did not. In addition, both participants and the ideal observer showed a bias toward responding “same,” and often showed a stronger influence of category coherence on change trials. The consistencies between participant and ideal observer responses suggest participants often behaved as they did because these behaviors are optimal (or approximately so) for maximizing task performance. This may help explain conflicting results reported in the scientific literature.  more » « less
Award ID(s):
1824737
PAR ID:
10543899
Author(s) / Creator(s):
 ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Cognitive Science
Volume:
48
Issue:
9
ISSN:
0364-0213
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Perceptual learning can significantly improve visual sensitivity even in fully matured adults. However, the ability to generalize learning to untrained conditions is often limited. While traditionally, perceptual learning is attributed to practice-dependent plasticity mechanisms, recent studies suggest that brief memory reactivations can efficiently improve visual perception, recruiting higher-level brain regions. Here we provide evidence that similar memory reactivation mechanisms promote generalization of offline learning mechanisms. Human participants encoded a visual discrimination task with the target stimulus at retinotopic location A. Then, brief memory reactivations of only five trials each were performed on separate days at location A. Generalization was tested at retinotopic location B. Results indicate remarkable enhancement of location B performance following memory reactivations, pointing to efficient offline generalization mechanisms. A control experiment with no reactivations showed minimal generalization. These findings suggest that reactivation-induced learning further enhances learning efficiency by promoting offline generalization mechanisms to untrained conditions, and can be further tested in additional learning domains, with potential future clinical implications. 
    more » « less
  2. Feature-based attention is known to enhance visual processing globally across the visual field, even at task-irrelevant locations. Here, we asked whether attention to object categories, in particular faces, shows similar location-independent tuning. Using EEG, we measured the face-selective N170 component of the EEG signal to examine neural responses to faces at task-irrelevant locations while participants attended to faces at another task-relevant location. Across two experiments, we found that visual processing of faces was amplified at task-irrelevant locations when participants attended to faces relative to when participants attended to either buildings or scrambled face parts. The fact that we see this enhancement with the N170 suggests that these attentional effects occur at the earliest stage of face processing. Two additional behavioral experiments showed that it is easier to attend to the same object category across the visual field relative to two distinct categories, consistent with object-based attention spreading globally. Together, these results suggest that attention to high-level object categories shows similar spatially global effects on visual processing as attention to simple, individual, low-level features. 
    more » « less
  3. null (Ed.)
    People can relatively easily report summary properties for ensembles of objects, suggesting that this information can enrich visual experience and increase the efficiency of perceptual processing. Here, we ask whether the ability to judge diversity within object arrays improves with experience. We surmised that ensemble judgments would be more accurate for commonly experienced objects, and perhaps even more for objects of expertise like faces. We also expected improvements in ensemble processing with practice with a novel category, and perhaps even more with repeated experience with specific exemplars. We compared the effect of experience on diversity judgments for arrays of objects, with participants being tested with either a small number of repeated exemplars or with a large number of exemplars from the same object category. To explore the role of more prolonged experience, we tested participants with completely novel objects (random-blobs), with objects familiar at the category level (cars), and with objects with which observers are experts at subordinate-level recognition (faces). For objects that are novel, participants showed evidence of improved ability to distribute attention. In contrast, for object categories with long-term experience, i.e., faces and cars, performance improved during the experiment but not necessarily due to improved ensemble processing. Practice with specific exemplars did not result in better diversity judgments for all object categories. Considered together, these results suggest that ensemble processing improves with experience. However, the role of experience is rapid, does not rely on exemplar-level knowledge and may not benefit from subordinate-level expertise. 
    more » « less
  4. null (Ed.)
    Category learning is fundamental to cognition, but little is known about how it proceeds in real-world environments when learners do not have instructions to search for category-relevant information, do not make overt category decisions, and do not experience direct feedback. Prior research demonstrates that listeners can acquire task-irrelevant auditory categories incidentally as they engage in primarily visuomotor tasks. The current study examines the factors that support this incidental category learning. Three experiments systematically manipulated the relationship of four novel auditory categories with a consistent visual feature (color or location) that informed a simple behavioral keypress response regarding the visual feature. In both an in-person experiment and two online replications with extensions, incidental auditory category learning occurred reliably when category exemplars consistently aligned with visuomotor demands of the primary task, but not when they were misaligned. The presence of an additional irrelevant visual feature that was uncorrelated with the primary task demands neither enhanced nor harmed incidental learning. By contrast, incidental learning did not occur when auditory categories were aligned consistently with one visual feature, but the motor response in the primary task was aligned with another, category-unaligned visual feature. Moreover, category learning did not reliably occur across passive observation or when participants made a category-nonspecific, generic motor response. These findings show that incidental learning of categories is strongly mediated by the character of coincident behavior. 
    more » « less
  5. Objective: Brain areas implicated in semantic memory can be damaged in patients with epilepsy (PWE). However, it is challenging to delineate semantic processing deficits from acoustic, linguistic, and other verbal aspects in current neuropsychological assessments. We developed a new Visual-based Semantic Association Task (ViSAT) to evaluate nonverbal semantic processing in PWE. Method: The ViSAT was adapted from similar predecessors (Pyramids & Palm Trees test, PPT; Camels & Cactus Test, CCT) comprised of 100 unique trials using real-life color pictures that avoid demographic, cultural, and other potential confounds. We obtained performance data from 23 PWE participants and 24 control participants (Control), along with crowdsourced normative data from 54 Amazon Mechanical Turk (Mturk) workers. Results: ViSAT reached a consensus >90% in 91.3% of trials compared to 83.6% in PPT and 82.9% in CCT. A deep learning model demonstrated that visual features of the stimulus images (color, shape; i.e., non-semantic) did not influence top answer choices (p = 0.577). The PWE group had lower accuracy than the Control group (p = 0.019). PWE had longer response times than the Control group in general and this was augmented for the semantic processing (trial answer) stage (both p < 0.001). Conclusions: This study demonstrated performance impairments in PWE that may reflect dysfunction of nonverbal semantic memory circuits, such as seizure onset zones overlapping with key semantic regions (e.g., anterior temporal lobe). The ViSAT paradigm avoids confounds, is repeatable/longitudinal, captures behavioral data, and is open-source, thus we propose it as a strong alternative for clinical and research assessment of nonverbal semantic memory. 
    more » « less