skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Automated and scalable Computerized Assessment of Motor Imitation (CAMI) in children with Autism Spectrum Disorder using a single 2D camera: A pilot study
Background: Motor imitation difficulties are pervasive in children with Autism Spectrum Disorder (ASD). Previous research demonstrated the validity and reliability of an algorithm called Computerized Assessment of Motor Imitation (CAMI) using 3D depth cameras. However, incorporating CAMI into serious games and making it accessible in clinic and home settings requires a more scalable approach that uses “off-the-shelf” 2D cameras. Method: In a brief (one-minute) task, children (23 ASD, 17 typically developing [TD]) imitated a model’s dance movements while simultaneously being recorded using Kinect Xbox motion tracking technology (Kinect 3D) and a single 2D camera. Pose-estimation software (OpenPose 2D) was used on the 2D camera video to fit a skeleton to the imitating child. Motor imitation scores computed from the fully automated OpenPose 2D CAMI method were compared to scores computed from the Kinect 3D CAMI and Human Observation Coding (HOC) methods. Results: Motor imitation scores obtained from the OpenPose 2D CAMI method were significantly correlated with scores obtained from the Kinect 3D CAMI method (r40 = 0.82, p < 0.001) and the HOC method (r40 = 0.80, p < 0.001). Both 2D and 3D CAMI methods showed better discriminative ability than the HOC, with the Kinect 3D CAMI method outperforming the OpenPose 2D CAMI method (area under ROC curve (AUC): AUCHOC = 0.799, AUC2D-CAMI = 0.876, AUC3D-CAMI= 0.94). Finally, all motor imitation scores were significantly associated with the social communication impairment (all p ≤ 0.003). Conclusions: This pilot-study demonstrated that motor imitation can be automatically quantified using a single 2D camera.  more » « less
Award ID(s):
2124276
PAR ID:
10570266
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Research in Autism Spectrum Disorders
Date Published:
Journal Name:
Research in Autism Spectrum Disorders
Volume:
87
ISSN:
1750-9467
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. BackgroundReliable and specific biomarkers that can distinguish autism spectrum disorders (ASDs) from commonly co-occurring attention-deficit/hyperactivity disorder (ADHD) are lacking, causing misses and delays in diagnosis, and reducing access to interventions and quality of life. AimsTo examine whether an innovative, brief (1-min), videogame method called Computerised Assessment of Motor Imitation (CAMI), can identify ASD-specific imitation differences compared with neurotypical children and children with ADHD. MethodThis cross-sectional study used CAMI alongside standardised parent-report (Social Responsiveness Scale, Second Edition) and observational measures of autism (Autism Diagnostic Observation Schedule-Second Edition; ADOS-2), ADHD (Conners) and motor ability (Physical and Neurological Examination for Soft Signs). The sample comprised 183 children aged 7–13 years, with ADHD (without ASD), with ASD (with and without ADHD) and who were neurotypical. ResultsRegardless of co-occurring ADHD, children with ASD showed poorer CAMI performance than neurotypical children (P< 0.0001; adjustedR2= 0.28), whereas children with ADHD and neurotypical children showed similar CAMI performance. Receiver operating curve and support vector machine analyses showed that CAMI distinguishes ASD from both neurotypical children (80% true positive rate) and children with ADHD (70% true positive rate), with a high success rate significantly above chance. Among children with ASD, poor CAMI performance was associated with increased autism traits, particularly ADOS-2 measures of social affect and restricted and repetitive behaviours (adjustedR2= 0.23), but not with ADHD traits or motor ability. ConclusionsFour levels of analyses confirm that poor imitation measured by the low-cost and scalable CAMI method specifically distinguishes ASD not only from neurotypical development, but also from commonly co-occurring ADHD. 
    more » « less
  2. Autism Spectrum Disorder (ASD) is a neurodevelopmental condition often associated with delayed motor skills. The Motor Assessment Battery for Children – Second Edition (MABC-2) is a standardized motor assessment for identifying motor delays pertaining to ASD. It evaluates fine and gross motor tasks across three domains: Manual Dexterity, Aiming & Catching, and Balance. These tasks are categorized into three age bands: 3-6, 7-10, and 11-16. Virtual Reality (VR) has emerged as a promising intervention in the ASD realm. This study aimed to investigate the potential of VR to assist children with ASD in performing the gross motor skills (i.e., ball skills and balance) in the MABC-2. The children who participated in the study were attendees of a local Autism Summer Camp. Our research focused on adapting motor tasks for ages 7-10 (i.e., Age Band 2) to VR, as most campers fell in this age range. Within the VR environment, children could observe avatar demonstrations and practice motor skills in a highly immersive setting. The VR environment featured avatars demonstrating ball skills and balancing tasks. Developed with the Unity game engine, 3D software Blender, C# scripting, and mixed reality toolkits, this environment was tested on the Meta Quest 2 Oculus. The children's gross motor skill performance was scored before and after VR interactions. The test standard scores were categorized through a traffic-light scoring system comprising red, amber, and green zones. A standard score ≤4 is classified in the red zone, indicating a significant movement difficulty; a standard score >4 and ≤7 is classified in the amber zone, indicating a risk for movement difficulty; and a standard score >7 is classified in the green zone, indicating no movement difficulty detected. Following the VR intervention, we observed a notable improvement in the balance score (p < 0.05). Furthermore, using the Random Forest machine learning model, we analyzed a combined dataset of MABC-2 scores from 250 children across all age bands from the Autism Summer Camp in previous years and the MABC-2 scores from the 18 children in the present study. Our analysis revealed that Balance was crucial in classifying children with ASD with motor delays, with an importance score of 0.195, nearly double that of Manual Dexterity and Aiming & Catching. When the model was exclusively applied to the Balance component score, it achieved an impressive accuracy rate of 91% in identifying children with ASD. In summary, our findings underscore the promise of VR in enhancing balance among children with ASD. The Random Forest analysis reaffirmed the significant role of balance in identifying children with ASD. Given its precision in detecting children with ASD based on their balance performance, we anticipate the potential of future machine learning advancements in this field. Our research validates the effectiveness of a VR-based approach and emphasizes the significance of collaborative research in providing valuable support to the underserved ASD population. 
    more » « less
  3. Reconstructing 4D vehicular activity (3D space and time) from cameras is useful for autonomous vehicles, commuters and local authorities to plan for smarter and safer cities. Traffic is inherently repetitious over long periods, yet current deep learning-based 3D reconstruction methods have not considered such repetitions and have difficulty generalizing to new intersection-installed cameras. We present a novel approach exploiting longitudinal (long-term) repetitious motion as self-supervision to reconstruct 3D vehicular activity from a video captured by a single fixed camera. Starting from off-the-shelf 2D keypoint detections, our algorithm optimizes 3D vehicle shapes and poses, and then clusters their trajectories in 3D space. The 2D keypoints and trajectory clusters accumulated over long-term are later used to improve the 2D and 3D keypoints via self-supervision without any human annotation. Our method improves reconstruction accuracy over state of the art on scenes with a significant visual difference from the keypoint detector’s training data, and has many applications including velocity estimation, anomaly detection and vehicle counting. We demonstrate results on traffic videos captured at multiple city intersections, collected using our smartphones, YouTube, and other public datasets. 
    more » « less
  4. Abstract In inclusive preschools, children with autism spectrum disorder (ASD) and other developmental disabilities (DD) are less socially engaged with peers than are typically developing (TD) children. However, there is limited objective information describing how children with ASD engage with teachers, or how teacher engagement compares to engagement with peers. We tracked over 750 hours' worth of children's (N = 77;NASD = 24,NDD = 23,NTD = 30;Mage = 43.98 months) and teachers' (N = 12) locations and orientations across eight inclusion preschool classrooms to quantify child‐teacher and child‐peer social preference. Social approach velocity and time in social contact were computed for each child and compared across social partners to index children's preference for teachers over peers. Children with ASD approached teachers–‐but not peers—more quickly than children with TD, and children with ASD were approached more quickly by teachers and more slowly by peers than children with TD. Children with ASD spent less time in social contact with peers and did not differ from children with TD in their time in social contact with teachers. Overall, children with ASD showed a greater preference for approaching, being approached by, and being in social contact with teachers (relative to peers) than children with TD. No significant differences emerged between children with DD and children with TD. In conclusion, children with ASD exhibited a stronger preference for engaging with teachers over peers, re‐emphasizing the need for classroom‐based interventions that support the peer interactions of children with ASD. 
    more » « less
  5. We demonstrate an improved two-camera system for multi-mass and multi-hit three-dimensional (3D) momentum imaging of ions. The imaging system employs two conventional complementary metal–oxide–semiconductor cameras. We have shown previously that the system can time slice ion Newton spheres with a time resolution of 8.8 ns, limited by camera timing jitter [J. Chem. Phys., 158, 191104 (2023)]. In this work, a jitter correction method was developed to suppress the camera jitter and improve the time resolution to better than 2 ns. With this resolution, full 3D momentum distributions of ions can be obtained. We further show that this method can detect two ions with different masses when utilizing both the rising and falling edges of the cameras. 
    more » « less