skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Automated and scalable Computerized Assessment of Motor Imitation (CAMI) in children with Autism Spectrum Disorder using a single 2D camera: A pilot study
Background: Motor imitation difficulties are pervasive in children with Autism Spectrum Disorder (ASD). Previous research demonstrated the validity and reliability of an algorithm called Computerized Assessment of Motor Imitation (CAMI) using 3D depth cameras. However, incorporating CAMI into serious games and making it accessible in clinic and home settings requires a more scalable approach that uses “off-the-shelf” 2D cameras. Method: In a brief (one-minute) task, children (23 ASD, 17 typically developing [TD]) imitated a model’s dance movements while simultaneously being recorded using Kinect Xbox motion tracking technology (Kinect 3D) and a single 2D camera. Pose-estimation software (OpenPose 2D) was used on the 2D camera video to fit a skeleton to the imitating child. Motor imitation scores computed from the fully automated OpenPose 2D CAMI method were compared to scores computed from the Kinect 3D CAMI and Human Observation Coding (HOC) methods. Results: Motor imitation scores obtained from the OpenPose 2D CAMI method were significantly correlated with scores obtained from the Kinect 3D CAMI method (r40 = 0.82, p < 0.001) and the HOC method (r40 = 0.80, p < 0.001). Both 2D and 3D CAMI methods showed better discriminative ability than the HOC, with the Kinect 3D CAMI method outperforming the OpenPose 2D CAMI method (area under ROC curve (AUC): AUCHOC = 0.799, AUC2D-CAMI = 0.876, AUC3D-CAMI= 0.94). Finally, all motor imitation scores were significantly associated with the social communication impairment (all p ≤ 0.003). Conclusions: This pilot-study demonstrated that motor imitation can be automatically quantified using a single 2D camera.  more » « less
Award ID(s):
2124276
PAR ID:
10570266
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Research in Autism Spectrum Disorders
Date Published:
Journal Name:
Research in Autism Spectrum Disorders
Volume:
87
ISSN:
1750-9467
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. BackgroundReliable and specific biomarkers that can distinguish autism spectrum disorders (ASDs) from commonly co-occurring attention-deficit/hyperactivity disorder (ADHD) are lacking, causing misses and delays in diagnosis, and reducing access to interventions and quality of life. AimsTo examine whether an innovative, brief (1-min), videogame method called Computerised Assessment of Motor Imitation (CAMI), can identify ASD-specific imitation differences compared with neurotypical children and children with ADHD. MethodThis cross-sectional study used CAMI alongside standardised parent-report (Social Responsiveness Scale, Second Edition) and observational measures of autism (Autism Diagnostic Observation Schedule-Second Edition; ADOS-2), ADHD (Conners) and motor ability (Physical and Neurological Examination for Soft Signs). The sample comprised 183 children aged 7–13 years, with ADHD (without ASD), with ASD (with and without ADHD) and who were neurotypical. ResultsRegardless of co-occurring ADHD, children with ASD showed poorer CAMI performance than neurotypical children (P< 0.0001; adjustedR2= 0.28), whereas children with ADHD and neurotypical children showed similar CAMI performance. Receiver operating curve and support vector machine analyses showed that CAMI distinguishes ASD from both neurotypical children (80% true positive rate) and children with ADHD (70% true positive rate), with a high success rate significantly above chance. Among children with ASD, poor CAMI performance was associated with increased autism traits, particularly ADOS-2 measures of social affect and restricted and repetitive behaviours (adjustedR2= 0.23), but not with ADHD traits or motor ability. ConclusionsFour levels of analyses confirm that poor imitation measured by the low-cost and scalable CAMI method specifically distinguishes ASD not only from neurotypical development, but also from commonly co-occurring ADHD. 
    more » « less
  2. Autism Spectrum Disorder (ASD) is a neurodevelopmental condition often associated with delayed motor skills. The Motor Assessment Battery for Children – Second Edition (MABC-2) is a standardized motor assessment for identifying motor delays pertaining to ASD. It evaluates fine and gross motor tasks across three domains: Manual Dexterity, Aiming & Catching, and Balance. These tasks are categorized into three age bands: 3-6, 7-10, and 11-16. Virtual Reality (VR) has emerged as a promising intervention in the ASD realm. This study aimed to investigate the potential of VR to assist children with ASD in performing the gross motor skills (i.e., ball skills and balance) in the MABC-2. The children who participated in the study were attendees of a local Autism Summer Camp. Our research focused on adapting motor tasks for ages 7-10 (i.e., Age Band 2) to VR, as most campers fell in this age range. Within the VR environment, children could observe avatar demonstrations and practice motor skills in a highly immersive setting. The VR environment featured avatars demonstrating ball skills and balancing tasks. Developed with the Unity game engine, 3D software Blender, C# scripting, and mixed reality toolkits, this environment was tested on the Meta Quest 2 Oculus. The children's gross motor skill performance was scored before and after VR interactions. The test standard scores were categorized through a traffic-light scoring system comprising red, amber, and green zones. A standard score ≤4 is classified in the red zone, indicating a significant movement difficulty; a standard score >4 and ≤7 is classified in the amber zone, indicating a risk for movement difficulty; and a standard score >7 is classified in the green zone, indicating no movement difficulty detected. Following the VR intervention, we observed a notable improvement in the balance score (p < 0.05). Furthermore, using the Random Forest machine learning model, we analyzed a combined dataset of MABC-2 scores from 250 children across all age bands from the Autism Summer Camp in previous years and the MABC-2 scores from the 18 children in the present study. Our analysis revealed that Balance was crucial in classifying children with ASD with motor delays, with an importance score of 0.195, nearly double that of Manual Dexterity and Aiming & Catching. When the model was exclusively applied to the Balance component score, it achieved an impressive accuracy rate of 91% in identifying children with ASD. In summary, our findings underscore the promise of VR in enhancing balance among children with ASD. The Random Forest analysis reaffirmed the significant role of balance in identifying children with ASD. Given its precision in detecting children with ASD based on their balance performance, we anticipate the potential of future machine learning advancements in this field. Our research validates the effectiveness of a VR-based approach and emphasizes the significance of collaborative research in providing valuable support to the underserved ASD population. 
    more » « less
  3. Reconstructing 4D vehicular activity (3D space and time) from cameras is useful for autonomous vehicles, commuters and local authorities to plan for smarter and safer cities. Traffic is inherently repetitious over long periods, yet current deep learning-based 3D reconstruction methods have not considered such repetitions and have difficulty generalizing to new intersection-installed cameras. We present a novel approach exploiting longitudinal (long-term) repetitious motion as self-supervision to reconstruct 3D vehicular activity from a video captured by a single fixed camera. Starting from off-the-shelf 2D keypoint detections, our algorithm optimizes 3D vehicle shapes and poses, and then clusters their trajectories in 3D space. The 2D keypoints and trajectory clusters accumulated over long-term are later used to improve the 2D and 3D keypoints via self-supervision without any human annotation. Our method improves reconstruction accuracy over state of the art on scenes with a significant visual difference from the keypoint detector’s training data, and has many applications including velocity estimation, anomaly detection and vehicle counting. We demonstrate results on traffic videos captured at multiple city intersections, collected using our smartphones, YouTube, and other public datasets. 
    more » « less
  4. Abstract Classroom engagement plays a crucial role in preschoolers' development, yet the correlates of engagement, especially among children with autism spectrum disorder (ASD) and developmental delays (DD), remains unknown. This study examines levels of engagement with classroom social partners and tasks among children in three groups ASD, DD, and typical development (TD). Here, we asked whether children's vocal interactions (vocalizations to and from peers and teachers) were associated with their classroom engagement with social partners (peers and teachers) and with tasks, and whether the association between classroom engagement and vocal interactions differed between children in the ASD group and their peers in the DD and TD groups. Automated measures of vocalizations and location quantified children's vocal interactions with peers and teachers over the course of the school year. Automated location and vocalization data were used to capture both (1) children's vocal output to specific peers and teachers, and (2) the vocal input they received from those peers and teachers. Participants were 72 3–5‐year‐olds (Mage = 48.6 months, SD = 7.0, 43% girls) and their teachers. Children in the ASD group displayed lower engagement with peers, teachers, and tasks than children in the TD group; they also showed lower engagement with peers than children in the DD group. Overall, children's own vocalizations were positively associated with engagement with social partners. Thus, although children in the ASD group tend to have lower engagement scores than children in the TD group, active participation in vocal interactions appears to support their classroom engagement with teachers and peers. 
    more » « less
  5. We demonstrate an improved two-camera system for multi-mass and multi-hit three-dimensional (3D) momentum imaging of ions. The imaging system employs two conventional complementary metal–oxide–semiconductor cameras. We have shown previously that the system can time slice ion Newton spheres with a time resolution of 8.8 ns, limited by camera timing jitter [J. Chem. Phys., 158, 191104 (2023)]. In this work, a jitter correction method was developed to suppress the camera jitter and improve the time resolution to better than 2 ns. With this resolution, full 3D momentum distributions of ions can be obtained. We further show that this method can detect two ions with different masses when utilizing both the rising and falling edges of the cameras. 
    more » « less