skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Measuring children’s eating behavior with a wearable device
Poor eating habits in children and teenagers can lead to obesity, eating disorders, or life-threatening health problems. Although researchers have studied children’s eating behavior for decades, the research community has had limited technology to support the observation and measurement of fine-grained details of a child’s eating behavior. In this paper, we present the feasibility of adapting the Auracle, an existing research-grade earpiece designed to automatically and unobtrusively recognize eating behavior in adults, for measuring children’s eating behavior. We identified and addressed several challenges pertaining to monitoring eating behavior in children, paying particular attention to device fit and comfort. We also improved the accuracy and robustness of the eating-activity detection algorithms. We used this improved prototype in a lab study with a sample of 10 children for 60 total sessions and collected 22.3 hours of data in both meal and snack scenarios. Overall, we achieved an accuracy exceeding 85.0% and an F1 score exceeding 84.2% for eating detection with a 3-second resolution, and a 95.5% accuracy and a 95.7% F1 score for eating detection with a 1-minute resolution.  more » « less
Award ID(s):
1835983
PAR ID:
10196444
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI).
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background Increased adoption of off-the-shelf conversational agents (CAs) brings opportunities to integrate therapeutic interventions. Motivational Interviewing (MI) can then be integrated with CAs for cost-effective access to it. MI can be especially beneficial for parents who often have low motivation because of limited time and resources to eat healthy together with their children. Objective We developed a Motivational Interviewing Conversational Agent (MICA) to improve healthy eating in parents who serve as a proxy for health behavior change in their children. Proxy relationships involve a person serving as a catalyst for behavior change in another person. Parents, serving as proxies, can bring about behavior change in their children. Methods We conducted user test sessions of the MICA prototype to understand the perceived acceptability and usefulness of the MICA prototype by parents. A total of 24 parents of young children participated in 2 user test sessions with MICA, approximately 2 weeks apart. After parents’ interaction with the MICA prototype in each user test session, we used qualitative interviews to understand parents’ perceptions and suggestions for improvements in MICA. Results Findings showed participants’ perceived usefulness of MICAs for helping them self-reflect and motivating them to adopt healthier eating habits together with their children. Participants further suggested various ways in which MICA can help them safely manage their children’s eating behaviors and provide customized support for their proxy needs and goals. Conclusions We have discussed how the user experience of CAs can be improved to uniquely offer support to parents who serve as proxies in changing the behavior of their children. We have concluded with implications for a larger context of designing MI-based CAs for supporting proxy relationships for health behavior change. 
    more » « less
  2. Disfluency detection and classification on children’s speech has a great potential for teaching reading skills. Word-level assessment of children’s speech can help teachers to effectively gauge their students’ progress. Hence, we propose a novel attention-based model to perform word-level disfluency detection and classification in a fully end-to-end (E2E) manner making it fast and easy to use. We develop a word-level disfluency annotation scheme using which we annotate a dataset of children read speech, the reading races dataset (READR). We also annotate disfluencies in the existing CMU Kids corpus. The proposed model significantly outperforms traditional cascaded baselines, which use forced alignments, on both datasets. To deal with the inevitable class-imbalance in the datasets, we propose a novel technique called HiDeC (Hierarchical Detection and Classification) which yields a detection improvement of 23% and 16% and a classification improvement of 3.8% and 19.3% relative F1-score on the READR and CMU Kids datasets respectively. 
    more » « less
  3. Over the years, researchers have explored various approaches for capturing and monitoring the eating activity, one among which is via Wi-Fi channel state information (CSI). CSI-based approaches commonly rely on multi-antenna systems for the capturing and monitoring tasks. With the advent of low-cost, single-antenna IoT devices with CSI measuring capabilities, a question that arises is whether these inexpensive devices can monitor human activities? In this paper we present the SandDune system that demonstrates the possibility of monitoring one human activity–eating–using only inexpensive single-antenna Wi-Fi devices. SandDune is an infrastructure-based system that continuously monitors CSI information to detect the eating activity occurring in its vicinity. When it detects an eating activity, it scrutinizes the signals further to identify all hand-to-mouth eating gestures in the eating episode. We tested SandDune and observed that SandDune can distinguish eating from other activities with an F1-score of 85.54%. Furthermore, it can detect the number of hand-to-mouth gestures that occurred in the eating episode with an error of ±3 gestures. Overall, we believe that a SandDune-like system can enable low cost, unobtrusive eating activity detection and monitoring with potential use-cases in several health and well-being applications. 
    more » « less
  4. An increase in volcanic thermal emissions can indicate subsurface and surface processes that precede, or coincide with, volcanic eruptions. Space-borne infrared sensors can detect hotspots—defined here as localized volcanic thermal emissions—in near-real-time. However, automatic hotspot detection systems are needed to efficiently analyze the large quantities of data produced. While hotspots have been automatically detected for over 20 years with simple thresholding algorithms, new computer vision technologies, such as convolutional neural networks (CNNs), can enable improved detection capabilities. Here we introduce HotLINK: the Hotspot Learning and Identification Network, a CNN trained to detect hotspots with a dataset of −3,800 satellite-based, Visible Infrared Imaging Radiometer Suite (VIIRS) images from Mount Veniaminof and Mount Cleveland volcanoes, Alaska. We find that our model achieves an accuracy of 96% (F1-score 0.92) when evaluated on −1,700 unseen images from the same volcanoes, and 95% (F1-score 0.67) when evaluated on −3,000 images from six additional Alaska volcanoes (Augustine Volcano, Bogoslof Island, Okmok Caldera, Pavlof Volcano, Redoubt Volcano, Shishaldin Volcano). In comparison with an existing threshold-based hotspot detection algorithm, MIROVA (Coppola et al., Geological Society, London, Special Publications, 2016, 426, 181–205), our model detects 22% more hotspots and produces 12% fewer false positives. Additional testing on −700 labeled Moderate Resolution Imaging Spectroradiometer (MODIS) images from Mount Veniaminof demonstrates that our model is applicable to this sensor’s data as well, achieving an accuracy of 98% (F1-score 0.95). We apply HotLINK to 10 years of VIIRS data and 22 years of MODIS data for the eight aforementioned Alaska volcanoes and calculate the radiative power of detected hotspots. From these time series we find that HotLINK accurately characterizes background and eruptive periods, similar to MIROVA, but also detects more subtle warming signals, potentially related to volcanic unrest. We identify three advantages to our model over its predecessors: 1) the ability to detect more subtle volcanic hotspots and produce fewer false positives, especially in daytime images; 2) probabilistic predictions provide a measure of detection confidence; and 3) its transferability, i.e., the successful application to multiple sensors and multiple volcanoes without the need for threshold tuning, suggesting the potential for global application. 
    more » « less
  5. Mountain snowpack provides critical water resources for forest and meadow ecosystems that are experiencing rapid change due to global warming. An accurate characterization of snowpack heterogeneity in these ecosystems requires snow cover observations at high spatial resolutions, yet most existing snow cover datasets have a coarse resolution. To advance our observation capabilities of snow cover in meadows and forests, we developed a machine learning model to generate snow-covered area (SCA) maps from PlanetScope imagery at about 3-m spatial resolution. The model achieves a median F1 score of 0.75 for 103 cloud-free images across four different sites in the Western United States and Switzerland. It is more accurate (F1 score = 0.82) when forest areas are excluded from the evaluation. We further tested the model performance across 7,741 mountain meadows at the two study sites in the Sierra Nevada, California. It achieved a median F1 score of 0.83, with higher accuracy for larger and simpler geometry meadows than for smaller and more complexly shaped meadows. While mapping SCA in regions close to or under forest canopy is still challenging, the model can accurately identify SCA for relatively large forest gaps (i.e., 15m < DCE < 27m), with a median F1 score of 0.87 across the four study sites, and shows promising accuracy for areas very close (>10m) to forest edges. Our study highlights the potential of high-resolution satellite imagery for mapping mountain snow cover in forested areas and meadows, with implications for advancing ecohydrological research in a world expecting significant changes in snow. 
    more » « less