skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: EarlyScreen: Multi-scale Instance Fusion for Predicting Neural Activation and Psychopathology in Preschool Children
Emotion dysregulation in early childhood is known to be associated with a higher risk of several psychopathological conditions, such as ADHD and mood and anxiety disorders. In developmental neuroscience research, emotion dysregulation is characterized by low neural activation in the prefrontal cortex during frustration. In this work, we report on an exploratory study with 94 participants aged 3.5 to 5 years, investigating whether behavioral measures automatically extracted from facial videos can predict frustration-related neural activation and differentiate between low- and high-risk individuals. We propose a novel multi-scale instance fusion framework to develop EarlyScreen - a set of classifiers trained on behavioral markers during emotion regulation. Our model successfully predicts activation levels in the prefrontal cortex with an area under the receiver operating characteristic (ROC) curve of 0.85, which is on par with widely-used clinical assessment tools. Further, we classify clinical and non-clinical subjects based on their psychopathological risk with an area under the ROC curve of 0.80. Our model's predictions are consistent with standardized psychometric assessment scales, supporting its applicability as a screening procedure for emotion regulation-related psychopathological disorders. To the best of our knowledge, EarlyScreen is the first work to use automatically extracted behavioral features to characterize both neural activity and the diagnostic status of emotion regulation-related disorders in young children. We present insights from mental health professionals supporting the utility of EarlyScreen and discuss considerations for its subsequent deployment.  more » « less
Award ID(s):
1839999 1815347
PAR ID:
10341549
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Volume:
6
Issue:
2
ISSN:
2474-9567
Page Range / eLocation ID:
1 to 39
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Traditionally, lust and pride have been considered pleasurable, yet sinful in the West. Conversely, guilt is often considered aversive, yet valuable. These emotions illustrate how evaluations about specific emotions and beliefs about their hedonic properties may often diverge. Evaluations about specific emotions may shape important aspects of emotional life (e.g. in emotion regulation, emotion experience and acquisition of emotion concepts). Yet these evaluations are often understudied in affective neuroscience. Prior work in emotion regulation, affective experience, evaluation/attitudes and decision-making point to anterior prefrontal areas as candidates for supporting evaluative emotion knowledge. Thus, we examined the brain areas associated with evaluative and hedonic emotion knowledge, with a focus on the anterior prefrontal cortex. Participants (N = 25) made evaluative and hedonic ratings about emotion knowledge during functional magnetic resonance imaging (fMRI). We found that greater activity in the medial prefrontal cortex (mPFC), ventromedial PFC (vmPFC) and precuneus was associated with an evaluative (vs hedonic) focus on emotion knowledge. Our results suggest that the mPFC and vmPFC, in particular, may play a role in evaluating discrete emotions. 
    more » « less
  2. Abstract Infancy is a sensitive period of development, during which experiences of parental care are particularly important for shaping the developing brain. In a longitudinal study ofN = 95 mothers and infants, we examined links between caregiving behavior (maternal sensitivity observed during a mother–infant free‐play) and infants’ neural response to emotion (happy, angry, and fearful faces) at 5 and 7 months of age. Neural activity was assessed using functional Near‐Infrared Spectroscopy (fNIRS) in the dorsolateral prefrontal cortex (dlPFC), a region involved in cognitive control and emotion regulation. Maternal sensitivity was positively correlated with infants’ neural responses tohappyfaces in the bilateral dlPFC and was associated with relative increases in such responses from 5 to 7 months. Multilevel analyses revealed caregiving‐related individual differences in infants’ neural responses to happy compared to fearful faces in the bilateral dlPFC, as well as other brain regions. We suggest that variability in dlPFC responses to emotion in the developing brain may be one correlate of early experiences of caregiving, with implications for social‐emotional functioning and self‐regulation. Research HighlightsInfancy is a sensitive period of brain development, during which experiences with caregivers are especially important.This study examined links between sensitive maternal care and infants’ neural responses to emotion at 5–7 months of age, using functional near‐infrared spectroscopy (fNIRS).Experiences of sensitive care were associated with infants’ neural responses to emotion—particularly happy faces—in the dorsolateral prefrontal cortex. 
    more » « less
  3. Parents’ alcohol use may influence adolescent substance use and substance use intentions. Prior research has linked adolescents’ emotion reactivity with parental drinking behaviors and adolescent substance use. The present study investigated whether sub-clinical maternal alcohol use relates to adolescent neural emotion reactivity and substance use intentions in early adolescence. Early adolescents ( N = 70) viewed emotional images during a fMRI scan and completed a questionnaire about substance use intentions. Their mothers reported past 30-day alcohol use. Results showed that greater frequency of maternal alcohol use predicted adolescents’ substance use intentions. In addition, maternal alcohol use predicted adolescent blunted responses to positive emotional images in the ventromedial prefrontal cortex (vmPFC) and bilateral anterior cingulate cortex (ACC). There was no relationship between neural emotion reactivity and adolescent substance use intentions. Findings suggest that parental alcohol use may relate to adolescent’s development of reward and positive emotion processing systems, even at sub-clinical levels of drinking. 
    more » « less
  4. null (Ed.)
    Abstract This paper presents the results of studying the brain activations of 30 engineering students when using three different design concept generation techniques: brainstorming, morphological analysis, and TRIZ. Changes in students’ brain activation in the prefrontal cortex were measured using functional near-infrared spectroscopy. The results are based on the area under the curve analysis of oxygenated hemodynamic response as well as an assessment of functional connectivity using Pearson’s correlation to compare students’ cognitive brain activations using these three different ideation techniques. The results indicate that brainstorming and morphological analysis demand more cognitive activation across the prefrontal cortex (PFC) compared to TRIZ. The highest cognitive activation when brainstorming and using morphological analysis is in the right dorsolateral PFC (DLPFC) and ventrolateral PFC. These regions are associated with divergent thinking and ill-defined problem-solving. TRIZ produces more cognitive activation in the left DLPFC. This region is associated with convergent thinking and making judgments. Morphological analysis and TRIZ also enable greater coordination (i.e., synchronized activation) between brain regions. These findings offer new evidence that structured techniques like TRIZ reduce cognitive activation, change patterns of activation and increase coordination between regions in the brain. 
    more » « less
  5. Risk propensity, or individuals’ attitude toward risk, can highly impact individuals’ decision-making in high-risk environments since those who merely focus on positive consequences associated with high-risk acts are more likely to engage in risk-taking behaviors. Previous studies identified activation in the prefrontal cortex during decision-making under risk to be a sign of an individual’s attitude toward risks. To investigate whether such past work—prevalent in behavioral research domains—translates into construction safety, this study conducted an experiment in a mixed-reality environment using functional near-infrared spectroscopy (fNIRS) technology to examine whether positive risk attitudes cause individuals to adopt risky construction behaviors and whether the activation of the prefrontal cortex of the brain can represent such risk attitudes. The results show that participants with a higher risk propensity had a higher brain activation during the risky electrical tasks; these individuals merely focused on gains, which motivated them to increase their risk-taking behavior and consequently experience more electrical accidents. Understanding workers’ attitudes toward risk will thus influence future understandings of decision behavior under risk. 
    more » « less