skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Pilot study of a real-time early agitation capture technology (REACT) for children with intellectual and developmental disabilities
Objective: Children and adolescents with intellectual and developmental disabilities (IDD), particularly those with autism spectrum disorder, are at increased risk of challenging behaviors such as self-injury, aggression, elopement, and property destruction. To mitigate these challenges, it is crucial to focus on early signs of distress that may lead to these behaviors. These early signs might not be visible to the human eye but could be detected by predictive machine learning (ML) models that utilizes real-time sensing. Current behavioral assessment practices lack such proactive predictive models. This study developed and pilot-tested real-time early agitation capture technology (REACT), a real-time multimodal ML model to detect early signs of distress, termed “agitations.” Integrating multimodal sensing, ML, and human expertise could make behavioral assessments for people with IDD safer and more efficient. Methods: We leveraged wearable technology to collect behavioral and physiological data from three children with IDD aged 6 to 9 years. The effectiveness of the REACT system was measured using F1 score, assessing its usefulness at the time of agitation to 20s prior. Results: The REACT system was able to detect agitations with an average F1 score of 78.69% at the time of agitation and 68.20% 20s prior. Conclusion: The findings support the use of the REACT model for real-time, proactive detection of agitations in children with IDD. This approach not only improves the accuracy of detecting distress signals that are imperceptible to the human eye but also increases the window for timely intervention before behavioral escalation, thereby enhancing safety, well-being, and inclusion for this vulnerable population. We believe that such technological support system will enhance user autonomy, self-advocacy, and self-determination.  more » « less
Award ID(s):
2124002
PAR ID:
10598404
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Sage Publisher
Date Published:
Journal Name:
Digital health
Volume:
10
ISSN:
2055-2076
Page Range / eLocation ID:
1-18
Subject(s) / Keyword(s):
Machine learning, wearable sensing, autism spectrum disorder, multimodal data, challenging behaviors
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract A substantial body of work has established that mothers’ internalizing distress can negatively affect children’s socioemotional development. Yet few studies have examined how distinct patterns of mothers’ distress over time differentially impact child behaviors across early childhood. To address this gap, the current study explored developmental trajectories of mothers’ internalizing distress and examined the associations of these patterns with child adjustment outcomes. Mexican immigrant, Dominican immigrant, and African American mothers (N= 272) were annually assessed for internalizing distress over the first 6 years following childbirth. Children’s psychological adjustment (internalizing, externalizing, and hyperactivity behaviors) was measured at the last yearly assessment in first grade. A growth mixture model revealed two distinct classes of distress where mothers were classified as having low stable distress (82.4%) or moderate distress that began as stable then declined when their children were 64 months old (17.6%). Children of mothers in themoderate, late declineclass showed greater internalizing, externalizing, and hyperactivity behaviors in the first grade compared to children of mothers in thelow stableclass. Findings highlight the necessity of supporting the mental health of ethnic minoritized mothers following childbirth and further expand our knowledge of family psychopathology to promote healthy psychological adjustment in children. 
    more » « less
  2. Previous studies have solely focused on establishing Machine Learning (ML) models for automated detection of stress arousal. However, these studies do not recognize stress appraisal and presume stress is a negative mental state. Yet, stress can be classified according to its influence on individuals; the way people perceive a stressor determines whether the stress reaction is considered as eustress (positive stress) or distress (negative stress). Thus, this study aims to assess the potential of using an ML approach to determine stress appraisal and identify eustress and distress instances using physiological and behavioral features. The results indicate that distress leads to higher perceived stress arousal compared to eustress. An XGBoost model that combined physiological and behavioral features using a 30 second time window had 83.38% and 78.79% F 1 -scores for predicting eustress and distress, respectively. Gender-based models resulted in an average increase of 2-4% in eustress and distress prediction accuracy. Finally, a model to predict the simultaneous assessment of eustress and distress, distinguishing between pure eustress, pure distress, eustress-distress coexistence, and the absence of stress achieved a moderate F 1 -score of 65.12%. The results of this study lay the foundation for work management interventions to maximize eustress and minimize distress in the workplace. 
    more » « less
  3. Introduction. Temper tantrums are common in early childhood. Severe emotional outbursts, however, are transdiagnostic, disruptive, and difficult to measure across settings, highlighting the need for better methods to identify and predict these components of emotion dysregulation. To address major methodological gaps, we propose a multimodal approach combining a retrospective electronic health record (EHR) analysis (Study 1) and a pilot wearable feasibility study (Study 2) to explore new ways of predicting and quantifying emotional outbursts in children enrolled in a therapeutic day program (TDP). Methods. In Study 1, we explored retrospective data collected from the EHR (historical patient data and hourly behavioral observations), trying to understand which variables might predict an outburst. In Study 2, wearable technology was employed to characterize outbursts leveraging free-living data collected during a typical day at a TDP. Moreover, we used these data to assess the future of possible outburst predictions among a clinical sample by analyzing the feasibility of such a technology. Results. An EHR analysis of 45 patients aged 4–8 years revealed that observed rough behaviors at the beginning of the day were associated with an increased likelihood of subsequent outbursts (p<.001), from 6% for those with zero rough behaviors to 68% for those with two or more such behaviors. Wearable sensor data demonstrated high tolerability (all four children assented each of 3–5 days of participation for 5 h of wear) and minimal data loss (<4%). Case studies of wearable-derived heart rate, heart rate variability, and skin temperature suggested that these factors might serve as promising indicators for detecting distress and outbursts. Discussion. Our results suggest that behavioral observation has the potential of predicting outbursts, and that wearable sensors are tolerable and feasible for children to wear. Overall, multiple methodologies should be studied concurrently and may be required to predict outbursts in the future. 
    more » « less
  4. null (Ed.)
    Objective: The objective of the study is to build models for early prediction of risk for developing multiple organ dysfunction (MOD) in pediatric intensive care unit (PICU) patients. Design: The design of the study is a retrospective observational cohort study. Setting: The setting of the study is at a single academic PICU at the Johns Hopkins Hospital, Baltimore, MD. Patients: The patients included in the study were <18 years of age admitted to the PICU between July 2014 and October 2015. Measurements and main results: Organ dysfunction labels were generated every minute from preceding 24-h time windows using the International Pediatric Sepsis Consensus Conference (IPSCC) and Proulx et al. MOD criteria. Early MOD prediction models were built using four machine learning methods: random forest, XGBoost, GLMBoost, and Lasso-GLM. An optimal threshold learned from training data was used to detect high-risk alert events (HRAs). The early prediction models from all methods achieved an area under the receiver operating characteristics curve ≥0.91 for both IPSCC and Proulx criteria. The best performance in terms of maximum F1-score was achieved with random forest (sensitivity: 0.72, positive predictive value: 0.70, F1-score: 0.71) and XGBoost (sensitivity: 0.8, positive predictive value: 0.81, F1-score: 0.81) for IPSCC and Proulx criteria, respectively. The median early warning time was 22.7 h for random forest and 37 h for XGBoost models for IPSCC and Proulx criteria, respectively. Applying spectral clustering on risk-score trajectories over 24 h following early warning provided a high-risk group with ≥0.93 positive predictive value. Conclusions: Early predictions from risk-based patient monitoring could provide more than 22 h of lead time for MOD onset, with ≥0.93 positive predictive value for a high-risk group identified pre-MOD. 
    more » « less
  5. The quality of parent-child interactions at an early age has been linked to children's social-emotional development, executive function, and risk for behavior problems. As such, parent-child interactions in naturalistic settings could present a unique opportunity to screen for at-risk behavior in young children, enabling timely and targeted interventions. In this work, we validate the feasibility of using structured at-home play sessions, completed via the Tandem smartphone app, to enable highly accurate and scalable behavioral assessments. We demonstrate that audio and physiological signals recorded during the play session can be used to capture key markers of parent-child interaction dynamics, which are more indicative of at-risk behavior compared to features from each individual alone. We propose novel audio-based dyadic interaction features that significantly outperform conventional speech features at predicting risk for behavior problems, achieving an F1 score of 0.87. Furthermore, we show that dyadic physiological synchrony features, extracted from privacy-preserving wearable sensor data, can classify at-risk behavior with an F1 score of 0.91. Tandem thus sets the stage for automated at-home behavior assessment tools for young children that balance screening accuracy with practical deployment considerations. 
    more » « less