skip to main content

This content will become publicly available on July 4, 2023

Title: EarlyScreen: Multi-scale Instance Fusion for Predicting Neural Activation and Psychopathology in Preschool Children
Emotion dysregulation in early childhood is known to be associated with a higher risk of several psychopathological conditions, such as ADHD and mood and anxiety disorders. In developmental neuroscience research, emotion dysregulation is characterized by low neural activation in the prefrontal cortex during frustration. In this work, we report on an exploratory study with 94 participants aged 3.5 to 5 years, investigating whether behavioral measures automatically extracted from facial videos can predict frustration-related neural activation and differentiate between low- and high-risk individuals. We propose a novel multi-scale instance fusion framework to develop EarlyScreen - a set of classifiers trained on behavioral markers during emotion regulation. Our model successfully predicts activation levels in the prefrontal cortex with an area under the receiver operating characteristic (ROC) curve of 0.85, which is on par with widely-used clinical assessment tools. Further, we classify clinical and non-clinical subjects based on their psychopathological risk with an area under the ROC curve of 0.80. Our model's predictions are consistent with standardized psychometric assessment scales, supporting its applicability as a screening procedure for emotion regulation-related psychopathological disorders. To the best of our knowledge, EarlyScreen is the first work to use automatically extracted behavioral features to characterize both neural more » activity and the diagnostic status of emotion regulation-related disorders in young children. We present insights from mental health professionals supporting the utility of EarlyScreen and discuss considerations for its subsequent deployment. « less
; ; ; ; ;
Award ID(s):
1839999 1815347
Publication Date:
Journal Name:
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Page Range or eLocation-ID:
1 to 39
Sponsoring Org:
National Science Foundation
More Like this
  1. Affective neuroscience research suggests that maturational changes in reward circuitry during adolescence present opportunities for new learning, but likely also contribute to increases in vulnerability for psychiatric disorders such as depression and substance abuse. Basic research in animal models and human neuroimaging has made progress in understanding the normal development of reward circuitry in adolescence, yet, few functional neuroimaging studies have examined puberty-related influences on the functioning of this circuitry. The goal of this study was to address this gap by examining the extent to which striatal activation and cortico-striatal functional connectivity to cues predicting upcoming rewards would be positively associated with pubertal status and levels of pubertal hormones (dehydroepiandrosterone, testosterone, estradiol). Participants included 79 adolescents (10-13 year olds; 47 girls) varying in pubertal status who performed a novel reward cue processing task during fMRI. Pubertal maturation was assessed using sex-specific standardized composite measures based on Tanner staging (self-report and clinical assessment) and scores from the Pubertal Development Scale. These composite measures were computed to index overall pubertal maturation as well as maturation of the adrenal and gonadal axes separately for boys and girls. Basal levels of circulating pubertal hormones were measured using immunoassays from three samples collected weekly upon awakeningmore »across a three-week period. Results indicated greater striatal activation and functional connectivity between nucleus accumbens (NAcc) and medial prefrontal cortex (mPFC) to reward cue (vs. no reward cue) on this task. Also, girls with higher levels of estradiol showed reduced activation in left and right caudate and greater NAcc-putamen connectivity. Girls with higher levels of testosterone showed greater NAcc connectivity with the anterior cingulate cortex and the insula. There were no significant associations in boys. Findings suggest that patterns of activation and connectivity in cortico-striatal regions are associated with reward cue processing, particularly in girls. Longitudinal follow-up neuroimaging studies are needed to fully characterize puberty-specific effects on the development of these neural regions and how such changes may contribute to pathways of risk or resilience in adolescence.« less
  2. Abstract

    Traditionally, lust and pride have been considered pleasurable, yet sinful in the West. Conversely, guilt is often considered aversive, yet valuable. These emotions illustrate how evaluations about specific emotions and beliefs about their hedonic properties may often diverge. Evaluations about specific emotions may shape important aspects of emotional life (e.g. in emotion regulation, emotion experience and acquisition of emotion concepts). Yet these evaluations are often understudied in affective neuroscience. Prior work in emotion regulation, affective experience, evaluation/attitudes and decision-making point to anterior prefrontal areas as candidates for supporting evaluative emotion knowledge. Thus, we examined the brain areas associated with evaluative and hedonic emotion knowledge, with a focus on the anterior prefrontal cortex. Participants (N = 25) made evaluative and hedonic ratings about emotion knowledge during functional magnetic resonance imaging (fMRI). We found that greater activity in the medial prefrontal cortex (mPFC), ventromedial PFC (vmPFC) and precuneus was associated with an evaluative (vs hedonic) focus on emotion knowledge. Our results suggest that the mPFC and vmPFC, in particular, may play a role in evaluating discrete emotions.

  3. Background The classic Marshmallow Test, where children were offered a choice between one small but immediate reward (eg, one marshmallow) or a larger reward (eg, two marshmallows) if they waited for a period of time, instigated a wealth of research on the relationships among impulsive responding, self-regulation, and clinical and life outcomes. Impulsivity is a hallmark feature of self-regulation failures that lead to poor health decisions and outcomes, making understanding and treating impulsivity one of the most important constructs to tackle in building a culture of health. Despite a large literature base, impulsivity measurement remains difficult due to the multidimensional nature of the construct and limited methods of assessment in daily life. Mobile devices and the rise of mobile health (mHealth) have changed our ability to assess and intervene with individuals remotely, providing an avenue for ambulatory diagnostic testing and interventions. Longitudinal studies with mobile devices can further help to understand impulsive behaviors and variation in state impulsivity in daily life. Objective The aim of this study was to develop and validate an impulsivity mHealth diagnostics and monitoring app called Digital Marshmallow Test (DMT) using both the Apple and Android platforms for widespread dissemination to researchers, clinicians, and the generalmore »public. Methods The DMT app was developed using Apple’s ResearchKit (iOS) and Android’s ResearchStack open source frameworks for developing health research study apps. The DMT app consists of three main modules: self-report, ecological momentary assessment, and active behavioral and cognitive tasks. We conducted a study with a 21-day assessment period (N=116 participants) to validate the novel measures of the DMT app. Results We used a semantic differential scale to develop self-report trait and momentary state measures of impulsivity as part of the DMT app. We identified three state factors (inefficient, thrill seeking, and intentional) that correlated highly with established measures of impulsivity. We further leveraged momentary semantic differential questions to examine intraindividual variability, the effect of daily life, and the contextual effect of mood on state impulsivity and daily impulsive behaviors. Our results indicated validation of the self-report sematic differential and related results, and of the mobile behavioral tasks, including the Balloon Analogue Risk Task and Go-No-Go task, with relatively low validity of the mobile Delay Discounting task. We discuss the design implications of these results to mHealth research. Conclusions This study demonstrates the potential for assessing different facets of trait and state impulsivity during everyday life and in clinical settings using the DMT mobile app. The DMT app can be further used to enhance our understanding of the individual facets that underlie impulsive behaviors, as well as providing a promising avenue for digital interventions. Trial Registration NCT03006653;« less
  4. Abstract This paper presents the results of studying the brain activations of 30 engineering students when using three different design concept generation techniques: brainstorming, morphological analysis, and TRIZ. Changes in students’ brain activation in the prefrontal cortex were measured using functional near-infrared spectroscopy. The results are based on the area under the curve analysis of oxygenated hemodynamic response as well as an assessment of functional connectivity using Pearson’s correlation to compare students’ cognitive brain activations using these three different ideation techniques. The results indicate that brainstorming and morphological analysis demand more cognitive activation across the prefrontal cortex (PFC) compared to TRIZ. The highest cognitive activation when brainstorming and using morphological analysis is in the right dorsolateral PFC (DLPFC) and ventrolateral PFC. These regions are associated with divergent thinking and ill-defined problem-solving. TRIZ produces more cognitive activation in the left DLPFC. This region is associated with convergent thinking and making judgments. Morphological analysis and TRIZ also enable greater coordination (i.e., synchronized activation) between brain regions. These findings offer new evidence that structured techniques like TRIZ reduce cognitive activation, change patterns of activation and increase coordination between regions in the brain.
  5. Abstract

    Gun violence is a major public health problem and costs the United States $280 billion annually (1). Although adolescents are disproportionately impacted (e.g. premature death), we know little about how close adolescents live to deadly gun violence incidents and whether such proximity impacts their socioemotional development (2, 3). Moreover, gun violence is likely to shape youth developmental outcomes through biological processes—including functional connectivity within regions of the brain that support emotion processing, salience detection, and physiological stress responses—though little work has examined this hypothesis. Lastly, it is unclear if strong neighborhood social ties can buffer youth from the neurobehavioral effects of gun violence. Within a nationwide birth cohort of 3,444 youth (56% Black, 24% Hispanic) born in large US cities, every additional deadly gun violence incident that occurred within 500 meters of home in the prior year was associated with an increase in behavioral problems by 9.6%, even after accounting for area-level crime and socioeconomic resources. Incidents that occurred closer to a child's home exerted larger effects, and stronger neighborhood social ties offset these associations. In a neuroimaging subsample (N = 164) of the larger cohort, living near more incidents of gun violence and reporting weaker neighborhood social ties weremore »associated with weaker amygdala–prefrontal functional connectivity during socioemotional processing, a pattern previously linked to less effective emotion regulation. Results provide spatially sensitive evidence for gun violence effects on adolescent behavior, a potential mechanism through which risk is biologically embedded, and ways in which positive community factors offset ecological risk.

    « less