Recognizing the affective state of children with autism spectrum disorder (ASD) in real-world settings poses challenges due to the varying head poses, illumination levels, occlusion and a lack of datasets annotated with emotions in in-the-wild scenarios. Understanding the emotional state of children with ASD is crucial for providing personalized interventions and support. Existing methods often rely on controlled lab environments, limiting their applicability to real-world scenarios. Hence, a framework that enables the recognition of affective states in children with ASD in uncontrolled settings is needed. This paper presents a framework for recognizing the affective state of children with ASD in an in-the-wild setting using heart rate (HR) information. More specifically, an algorithm is developed that can classify a participant’s emotion as positive, negative, or neutral by analyzing the heart rate signal acquired from a smartwatch. The heart rate data are obtained in real time using a smartwatch application while the child learns to code a robot and interacts with an avatar. The avatar assists the child in developing communication skills and programming the robot. In this paper, we also present a semi-automated annotation technique based on facial expression recognition for the heart rate data. The HR signal is analyzed to extract features that capture the emotional state of the child. Additionally, in this paper, the performance of a raw HR-signal-based emotion classification algorithm is compared with a classification approach based on features extracted from HR signals using discrete wavelet transform (DWT). The experimental results demonstrate that the proposed method achieves comparable performance to state-of-the-art HR-based emotion recognition techniques, despite being conducted in an uncontrolled setting rather than a controlled lab environment. The framework presented in this paper contributes to the real-world affect analysis of children with ASD using HR information. By enabling emotion recognition in uncontrolled settings, this approach has the potential to improve the monitoring and understanding of the emotional well-being of children with ASD in their daily lives.
- Award ID(s):
- 1947972
- PAR ID:
- 10443674
- Publisher / Repository:
- Annual Review of Clinical Psychology
- Date Published:
- Journal Name:
- Annual Review of Clinical Psychology
- Volume:
- 18
- Issue:
- 1
- ISSN:
- 1548-5943
- Page Range / eLocation ID:
- 553 to 580
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
null (Ed.)Prior papers have explored the functional connectivity changes for patients suffering from major depressive disorder (MDD). This paper introduces an approach for classifying adolescents suffering from MDD using resting-state fMRI. Accurate diagnosis of MDD involves interviews with adolescent patients and their parents, symptom rating scales based on Diagnostic and Statistical Manual of Mental Disorders (DSM), behavioral observation as well as the experience of a clinician. Discovering predictive biomarkers for diagnosing MDD patients using functional magnetic resonance imaging (fMRI) scans can assist the clinicians in their diagnostic assessments. This paper investigates various static and dynamic connectivity measures extracted from resting-state fMRI for assisting with MDD diagnosis. First, absolute Pearson correlation matrices from 85 brain regions are computed and they are used to calculate static features for predicting MDD. A predictive sub-network extracted using sub-graph entropy classifies adolescent MDD vs. typical healthy controls with high accuracy, sensitivity and specificity. Next, approaches utilizing dynamic connectivity are employed to extract tensor based, independent component based and principal component based subject specific attributes. Finally, features from static and dynamic approaches are combined to create a feature vector for classification. A leave-one-out cross-validation method is used for the final predictor performance. Out of 49 adolescents with MDD and 33 matched healthy controls, a support vector machine (SVM) classifier using a radial basis function (RBF) kernel using differential sub-graph entropy combined with dynamic connectivity features classifies MDD vs. healthy controls with an accuracy of 0.82 for leave-one-out cross-validation. This classifier has specificity and sensitivity of 0.79 and 0.84, respectively. This performance demonstrates the utility of MRI based diagnosis of psychiatric disorders like MDD using a combination of static and dynamic functional connectivity features of the brain.more » « less
-
null (Ed.)Selective serotonin reuptake inhibitors (SSRIs) are a standard of care for the pharmacotherapy of patients suffering from Major Depressive Disorder (MDD). However, only one-half to two-thirds of MDD patients respond to SSRI therapy. Recently, a “multiple omics” research strategy was applied to identify genetic differences between patients who did and did not respond to SSRI therapy. As a first step, plasma metabolites were assayed using samples from the 803 patients in the PGRN-AMPS SSRI MDD trial. The metabolomics data were then used to “inform” genomics by performing a genome-wide association study (GWAS) for plasma concentrations of the metabolite most highly associated with clinical response, serotonin (5-HT). Two genome-wide or near genome-wide significant single nucleotide polymorphism (SNP) signals were identified, one that mapped near the TSPAN5 gene and another across the ERICH3 gene, both genes that are highly expressed in the brain. Knocking down TSPAN5 and ERICH3 resulted in decreased 5-HT concentrations in neuroblastoma cell culture media and decreased expression of enzymes involved in 5-HT biosynthesis and metabolism. Functional genomic studies demonstrated that ERICH3 was involved in clathrin-mediated vesicle formation and TSPAN5 was an ethanol-responsive gene that may be a marker for response to acamprosate pharmacotherapy of alcohol use disorder (AUD), a neuropsychiatric disorder highly co-morbid with MDD. In parallel studies, kynurenine was the plasma metabolite most highly associated with MDD symptom severity and application of a metabolomics-informed pharmacogenomics approach identified DEFB1 and AHR as genes associated with variation in plasma kynurenine levels. Both genes also contributed to kynurenine-related inflammatory pathways. Finally, a multiply replicated predictive algorithm for SSRI clinical response with a balanced predictive accuracy of 76% (compared with 56% for clinical data alone) was developed by including the SNPs in TSPAN5 , ERICH3 , DEFB1 and AHR . In summary, application of a multiple omics research strategy that used metabolomics to inform genomics, followed by functional genomic studies, identified novel genes that influenced monoamine biology and made it possible to develop a predictive algorithm for SSRI clinical outcomes in MDD. A similar pharmaco-omic research strategy might be broadly applicable for the study of other neuropsychiatric diseases and their drug therapy.more » « less
-
more » « less
Abstract Posttraumatic stress disorder (PTSD) and major depressive disorder (MDD) commonly co‐occur in combat veterans, and this comorbidity has been associated with higher levels of distress and more social and economic costs compared to one disorder alone. In a secondary analysis of a multisite randomized controlled trial of a sample of veterans with combat‐related PTSD, we examined the associations among pre‐, peri‐, and postdeployment adversity, social support, and clinician‐diagnosed comorbid MDD. Participants completed the Deployment Risk and Resilience Inventory and the Beck Depression Inventory–II as well as structured clinical interviews for diagnostic status. Among 223 U.S. veterans of the military operations in Iraq and Afghanistan (86.9% male) with primary combat‐related PTSD, 69.5% had current comorbid MDD. After adjustment for sex, a linear regression model indicated that more concerns about family disruptions during deployment,
f 2= 0.065; more harassment during deployment,f 2= 0.020; and lower ratings of postdeployment social support,f 2= 0.154, were associated with more severe self‐reported depression symptoms. Interventions that enhance social support as well as societal efforts to foster successful postdeployment reintegration are critical for reducing the mental health burden associated with this highly prevalent comorbidity in veterans with combat‐related PTSD. -
more » « less
Abstract Major depressive disorder (MDD) is a leading cause of disability worldwide. Individuals with MDD exhibit decreased motivation and deficits in reward processing. In a subset of MDD patients, chronic dysregulation of the hypothalamic-pituitary-adrenal (HPA) axis occurs, resulting in increased levels of the ‘stress hormone’ cortisol during the normal rest period (i.e., evening and night). However, the mechanistic relationship between chronically elevated resting cortisol and behavioral deficits in motivation and reward processing remains unclear. Given that women are diagnosed with MDD at twice the rate of men, it is important to understand whether the mechanisms linking cortisol to the symptoms of MDD differ by sex. In this study, we used subcutaneous implants to chronically elevate free plasma corticosterone (the rodent homolog of cortisol; ‘CORT’) during the rest period in male and female mice and examined changes in behavior and dopamine system function. We found that chronic CORT treatment impaired motivated reward-seeking in both sexes. In female but not male mice, CORT treatment reduced dopamine content in the dorsomedial striatum (DMS). In male but not female mice, CORT treatment impaired the function of the dopamine transporter (DAT) in DMS. From these studies, we conclude that chronic CORT dysregulation impairs motivation by impairing dopaminergic transmission in the DMS, but via different mechanisms in male and female mice. A better understanding of these sex-specific mechanisms could lead to new directions in MDD diagnosis and treatment.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1146/annurev-clinpsy-081219-115627
