skip to main content


Search for: All records

Creators/Authors contains: "Sano, Akane."

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

  1. Abstract Emotion prediction plays an essential role in mental healthcare and emotion-aware computing. The complex nature of emotion resulting from its dependency on a person’s physiological health, mental state, and his surroundings makes its prediction a challenging task. In this work, we utilize mobile sensing data to predict self-reported happiness and stress levels. In addition to a person’s physiology, we also incorporate the environment’s impact through weather and social network. To this end, we leverage phone data to construct social networks and develop a machine learning architecture that aggregates information from multiple users of the graph network and integrates it with the temporal dynamics of data to predict emotion for all users. The construction of social networks does not incur additional costs in terms of ecological momentary assessments or data collection from users and does not raise privacy concerns. We propose an architecture that automates the integration of the user’s social network in affect prediction and is capable of dealing with the dynamic distribution of real-life social networks, making it scalable to large-scale networks. The extensive evaluation highlights the prediction performance improvement provided by the integration of social networks. We further investigate the impact of graph topology on the model’s performance. 
    more » « less
    Free, publicly-accessible full text available December 1, 2024
  2. Physiological and behavioral data collected from wearable or mobile sensors have been used to estimate self-reported stress levels. Since stress annotation usually relies on self-reports during the study, a limited amount of labeled data can be an obstacle to developing accurate and generalized stress-predicting models. On the other hand, the sensors can continuously capture signals without annotations. This work investigates leveraging unlabeled wearable sensor data for stress detection in the wild. We propose a two-stage semi-supervised learning framework that leverages wearable sensor data to help with stress detection. The proposed structure consists of an auto-encoder pre-training method for learning information from unlabeled data and the consistency regularization approach to enhance the robustness of the model. Besides, we propose a novel active sampling method for selecting unlabeled samples to avoid introducing redundant information to the model. We validate these methods using two datasets with physiological signals and stress labels collected in the wild, as well as four human activity recognition (HAR) datasets to evaluate the generality of the proposed method. Our approach demonstrated competitive results for stress detection, improving stress classification performance by approximately 7% to 10% on the stress detection datasets compared to the baseline supervised learning models. Furthermore, the ablation study we conducted for the HAR tasks supported the effectiveness of our methods. Our approach showed comparable performance to state-of-the-art semi-supervised learning methods for both stress detection and HAR tasks. 
    more » « less
    Free, publicly-accessible full text available June 12, 2024
  3. Data augmentation is a common practice to help generalization in the procedure of deep model training. In the context of physiological time series classification, previous research has primarily focused on label-invariant data augmentation methods. However, another class of augmentation techniques (i.e., Mixup) that emerged in the computer vision field has yet to be fully explored in the time series domain. In this study, we systematically review the mix-based augmentations, including mixup, cutmix, and manifold mixup, on six physio- logical datasets, evaluating their performance across different sensory data and classification tasks. Our results demonstrate that the three mix-based augmentations can consistently improve the performance on the six datasets. More importantly, the improvement does not rely on expert knowledge or extensive parameter tuning. Lastly, we provide an overview of the unique properties of the mix-based augmentation methods and highlight the potential benefits of using the mix-based augmentation in physiological time series data. Our code and results are available at https://github.com/comp-well-org/ Mix-Augmentation-for-Physiological-Time-Series-Classification. 
    more » « less
  4. Background Shift workers are at high risk of developing sleep disorders such as shift worker sleep disorder or chronic insomnia. Cognitive behavioral therapy (CBT) is the first-line treatment for insomnia, and emerging evidence shows that internet-based CBT is highly effective with additional features such as continuous tracking and personalization. However, there are limited studies on internet-based CBT for shift workers with sleep disorders. Objective This study aimed to evaluate the impact of a 4-week, physician-assisted, internet-delivered CBT program incorporating machine learning–based well-being prediction on the sleep duration of shift workers at high risk of sleep disorders. We evaluated these outcomes using an internet-delivered CBT app and fitness trackers in the intensive care unit. Methods A convenience sample of 61 shift workers (mean age 32.9, SD 8.3 years) from the intensive care unit or emergency department participated in the study. Eligible participants were on a 3-shift schedule and had a Pittsburgh Sleep Quality Index score ≥5. The study comprised a 1-week baseline period, followed by a 4-week intervention period. Before the study, the participants completed questionnaires regarding the subjective evaluation of sleep, burnout syndrome, and mental health. Participants were asked to wear a commercial fitness tracker to track their daily activities, heart rate, and sleep for 5 weeks. The internet-delivered CBT program included well-being prediction, activity and sleep chart, and sleep advice. A job-based multitask and multilabel convolutional neural network–based model was used for well-being prediction. Participant-specific sleep advice was provided by sleep physicians based on daily surveys and fitness tracker data. The primary end point of this study was sleep duration. For continuous measurements (sleep duration, steps, etc), the mean baseline and week-4 intervention data were compared. The 2-tailed paired t test or Wilcoxon signed rank test was performed depending on the distribution of the data. Results In the fourth week of intervention, the mean daily sleep duration for 7 days (6.06, SD 1.30 hours) showed a statistically significant increase compared with the baseline (5.54, SD 1.36 hours; P=.02). Subjective sleep quality, as measured by the Pittsburgh Sleep Quality Index, also showed statistically significant improvement from baseline (9.10) to after the intervention (7.84; P=.001). However, no significant improvement was found in the subjective well-being scores (all P>.05). Feature importance analysis for all 45 variables in the prediction model showed that sleep duration had the highest importance. Conclusions The physician-assisted internet-delivered CBT program targeting shift workers with a high risk of sleep disorders showed a statistically significant increase in sleep duration as measured by wearable sensors along with subjective sleep quality. This study shows that sleep improvement programs using an app and wearable sensors are feasible and may play an important role in preventing shift work–related sleep disorders. International Registered Report Identifier (IRRID) RR2-10.2196/24799. 
    more » « less
  5. In this mini-review, we discuss the fundamentals of using technology in mental health diagnosis and tracking. We highlight those principles using two clinical concepts: (1) cravings and relapse in the context of addictive disorders and (2) anhedonia in the context of depression. This manuscript is useful for both clinicians wanting to understand the scope of technology use in psychiatry and for computer scientists and engineers wishing to assess psychiatric frameworks useful for diagnosis and treatment. The increase in smartphone ownership and internet connectivity, as well as the accelerated development of wearable devices, have made the observation and analysis of human behavior patterns possible. This has, in turn, paved the way to understand mental health conditions better. These technologies have immense potential in facilitating the diagnosis and tracking of mental health conditions; they also allow the implementation of existing behavioral treatments in new contexts (e.g., remotely, online, and in rural/underserved areas), and the possibility to develop new treatments based on new understanding of behavior patterns. The path to understand how to best use technology in mental health includes the need to match interdisciplinary frameworks from engineering/computer sciences and psychiatry. Thus, we start our review by introducing bio-behavioral sensing, the types of information available, and what behavioral patterns they may reflect and be related to in psychiatric diagnostic frameworks. This information is linked to the use of functional imaging, highlighting how imaging modalities can be considered “ground truth” for mental health/psychiatric dimensions, given the heterogeneity of clinical presentations, and the difficulty of determining what symptom corresponds to what disease. We then discuss how mental health/psychiatric dimensions overlap, yet differ from, psychiatric diagnoses. Using two clinical examples, we highlight the potential agreement areas in assessment/management of anhedonia and cravings. These two dimensions were chosen because of their link to two very prevalent diseases worldwide: depression and addiction. Anhedonia is a core symptom of depression, which is one of the leading causes of disability worldwide. Cravings, the urge to use a substance or perform an action (e.g., shopping, internet), is the leading step before relapse. Lastly, through the manuscript, we discuss potential mental health dimensions. 
    more » « less