skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, January 16 until 2:00 AM ET on Friday, January 17 due to maintenance. We apologize for the inconvenience.


Title: Color, Music, and Emotion: Bach to the Blues

When people make cross-modal matches from classical music to colors, they choose colors whose emotional associations fit the emotional associations of the music, supporting the emotional mediation hypothesis. We further explored this result with a large, diverse sample of 34 musical excerpts from different genres, including Blues, Salsa, Heavy metal, and many others, a broad sample of 10 emotion-related rating scales, and a large range of 15 rated music–perceptual features. We found systematic music-to-color associations between perceptual features of the music and perceptual dimensions of the colors chosen as going best/worst with the music (e.g., loud, punchy, distorted music was generally associated with darker, redder, more saturated colors). However, these associations were also consistent with emotional mediation (e.g., agitated-sounding music was associated with agitated-looking colors). Indeed, partialling out the variance due to emotional content eliminated all significant cross-modal correlations between lower level perceptual features. Parallel factor analysis (Parafac, a type of factor analysis that encompasses individual differences) revealed two latent affective factors— arousal and valence—which mediated lower level correspondences in music-to-color associations. Participants thus appear to match music to colors primarily in terms of common, mediating emotional associations.

 
more » « less
PAR ID:
10522854
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
i-Perception
Volume:
9
Issue:
6
ISSN:
2041-6695
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Color encoding is foundational to visualizing quantitative data. Guidelines for colormap design have traditionally emphasized perceptual principles, such as order and uniformity. However, colors also evoke cognitive and linguistic associations whose role in data interpretation remains underexplored. We study how two linguistic factors, name salience and name variation, affect people's ability to draw inferences from spatial visualizations. In two experiments, we found that participants are better at interpreting visualizations when viewing colors with more salient names (e.g., prototypical ‘blue’, ‘yellow’, and ‘red’ over ‘teal’, ‘beige’, and ‘maroon’). The effect was robust across four visualization types, but was more pronounced in continuous (e.g., smooth geographical maps) than in similar discrete representations (e.g., choropleths). Participants' accuracy also improved as the number of nameable colors increased, although the latter had a less robust effect. Our findings suggest that color nameability is an important design consideration for quantitative colormaps, and may even outweigh traditional perceptual metrics. In particular, we found that the linguistic associations of color are a better predictor of performance than the perceptual properties of those colors. We discuss the implications and outline research opportunities. The data and materials for this study are available athttps://osf.io/asb7n

     
    more » « less
  2. Abstract

    Is engaging with music good for your mental health? This question has long been the topic of empirical clinical and nonclinical investigations, with studies indicating positive associations between music engagement and quality of life, reduced depression or anxiety symptoms, and less frequent substance use. However, many earlier investigations were limited by small populations and methodological limitations, and it has also been suggested that aspects of music engagement may even be associated with worse mental health outcomes. The purpose of this scoping review is first to summarize the existing state of music engagement and mental health studies, identifying their strengths and weaknesses. We focus on broad domains of mental health diagnoses including internalizing psychopathology (e.g., depression and anxiety symptoms and diagnoses), externalizing psychopathology (e.g., substance use), and thought disorders (e.g., schizophrenia). Second, we propose a theoretical model to inform future work that describes the importance of simultaneously considering music-mental health associations at the levels of (1) correlated genetic and/or environmental influences vs. (bi)directional associations, (2) interactions with genetic risk factors, (3) treatment efficacy, and (4) mediation through brain structure and function. Finally, we describe how recent advances in large-scale data collection, including genetic, neuroimaging, and electronic health record studies, allow for a more rigorous examination of these associations that can also elucidate their neurobiological substrates.

     
    more » « less
  3. Abstract

    Selective attention improves sensory processing of relevant information but can also impact the quality of perception. For example, attention increases visual discrimination performance and at the same time boosts apparent stimulus contrast of attended relative to unattended stimuli. Can attention also lead to perceptual distortions of visual representations? Optimal tuning accounts of attention suggest that processing is biased towards “off-tuned” features to maximize the signal-to-noise ratio in favor of the target, especially when targets and distractors are confusable. Here, we tested whether such tuning gives rise to phenomenological changes of visual features. We instructed participants to select a color among other colors in a visual search display and subsequently asked them to judge the appearance of the target color in a 2-alternative forced choice task. Participants consistently judged the target color to appear more dissimilar from the distractor color in feature space. Critically, the magnitude of these perceptual biases varied systematically with the similarity between target and distractor colors during search, indicating that attentional tuning quickly adapts to current task demands. In control experiments we rule out possible non-attentional explanations such as color contrast or memory effects. Overall, our results demonstrate that selective attention warps the representational geometry of color space, resulting in profound perceptual changes across large swaths of feature space. Broadly, these results indicate that efficient attentional selection can come at a perceptual cost by distorting our sensory experience.

     
    more » « less
  4. Abstract

    We present an extensive archival analysis of a sample of local galaxies, combining multiwavelength data from GALEX, Spitzer, and Herschel to investigate “blue-side” mid-infrared (MIR) and “red-side” far-infrared (FIR) color–color correlations within the observed infrared spectral energy distributions. Our sample largely consists of the KINGFISH galaxies, with the important addition of a select few including NGC 5236 (M83) and NGC 4449. With data from the far-ultraviolet (∼0.15μm) through 500μm convolved to common angular resolution, we measure the photometry of kiloparsec-scale star-forming regions 36″ × 36″ in size. Star formation rates (SFRs), stellar masses, and metallicity distributions are derived throughout our sample. Focusing on thef70/f500“FIR” andf8/f24“MIR” flux density ratios (colors), we find that a subsample of galaxies demonstrate a strong IR color–color correlation within their star-forming regions, while others demonstrate uncorrelated colors. This division is driven by two main effects: (1) the local strength of star formation (SF) and (2) the metal content of the interstellar medium (ISM). Galaxies uniformly dominated by high surface densities of SF (e.g., NGC 5236) demonstrate strong IR color–color correlations, while galaxies that exhibit lower levels of SF and mixed environments (e.g., NGC 5457) demonstrate weaker or no correlation—explained by the increasing effect of varying ISM heating and metal content on the IR colors, specifically in the MIR. We find large dispersion in the SFR–L8(8μm luminosity) relation that is traced by the metallicity distributions, consistent with extant studies, highlighting its problematic use as an SFR indicator across diverse systems/samples.

     
    more » « less
  5. Certain colors are strongly associated with certain adjectives (e.g. red is hot, blue is cold). Some of these associations are grounded in visual experiences like seeing hot embers glow red. Surprisingly, many congenitally blind people show similar color associations, despite lacking all visual experience of color. Presumably, they learn these associations via language. Can we detect these associations in the statistics of language? And if so, what form do they take? We apply a projection method to word embeddings trained on corpora of spoken and written text to identify color-adjective associations as they are represented in language. We show that these projections are predictive of color-adjective ratings collected from blind and sighted people, and that the effect size depends on the training corpus. Finally, we examine how color-adjective associations might be represented in language by training word embeddings on corpora from which various sources of color-semantic information are removed. 
    more » « less