An official website of the United States government
Background Shift workers are at high risk of developing sleep disorders such as shift worker sleep disorder or chronic insomnia. Cognitive behavioral therapy (CBT) is the first-line treatment for insomnia, and emerging evidence shows that internet-based CBT is highly effective with additional features such as continuous tracking and personalization. However, there are limited studies on internet-based CBT for shift workers with sleep disorders. Objective This study aimed to evaluate the impact of a 4-week, physician-assisted, internet-delivered CBT program incorporating machine learning–based well-being prediction on the sleep duration of shift workers at high risk of sleep disorders. We evaluated these outcomes using an internet-delivered CBT app and fitness trackers in the intensive care unit. Methods A convenience sample of 61 shift workers (mean age 32.9, SD 8.3 years) from the intensive care unit or emergency department participated in the study. Eligible participants were on a 3-shift schedule and had a Pittsburgh Sleep Quality Index score ≥5. The study comprised a 1-week baseline period, followed by a 4-week intervention period. Before the study, the participants completed questionnaires regarding the subjective evaluation of sleep, burnout syndrome, and mental health. Participants were asked to wear a commercial fitness tracker to track their daily activities, heart rate, and sleep for 5 weeks. The internet-delivered CBT program included well-being prediction, activity and sleep chart, and sleep advice. A job-based multitask and multilabel convolutional neural network–based model was used for well-being prediction. Participant-specific sleep advice was provided by sleep physicians based on daily surveys and fitness tracker data. The primary end point of this study was sleep duration. For continuous measurements (sleep duration, steps, etc), the mean baseline and week-4 intervention data were compared. The 2-tailed paired t test or Wilcoxon signed rank test was performed depending on the distribution of the data. Results In the fourth week of intervention, the mean daily sleep duration for 7 days (6.06, SD 1.30 hours) showed a statistically significant increase compared with the baseline (5.54, SD 1.36 hours; P=.02). Subjective sleep quality, as measured by the Pittsburgh Sleep Quality Index, also showed statistically significant improvement from baseline (9.10) to after the intervention (7.84; P=.001). However, no significant improvement was found in the subjective well-being scores (all P>.05). Feature importance analysis for all 45 variables in the prediction model showed that sleep duration had the highest importance. Conclusions The physician-assisted internet-delivered CBT program targeting shift workers with a high risk of sleep disorders showed a statistically significant increase in sleep duration as measured by wearable sensors along with subjective sleep quality. This study shows that sleep improvement programs using an app and wearable sensors are feasible and may play an important role in preventing shift work–related sleep disorders. International Registered Report Identifier (IRRID) RR2-10.2196/24799.
more »
« less
Personalized Physician-Assisted Sleep Advice for Shift Workers: Algorithm Development and Validation Study
BackgroundIn the modern economy, shift work is prevalent in numerous occupations. However, it often disrupts workers’ circadian rhythms and can result in shift work sleep disorder. Proper management of shift work sleep disorder involves comprehensive and patient-specific strategies, some of which are similar to cognitive behavioral therapy for insomnia. ObjectiveOur goal was to develop and evaluate machine learning algorithms that predict physicians’ sleep advice using wearable and survey data. We developed a web- and app-based system to provide individualized sleep and behavior advice based on cognitive behavioral therapy for insomnia for shift workers. MethodsData were collected for 5 weeks from shift workers (N=61) in the intensive care unit at 2 hospitals in Japan. The data comprised 3 modalities: Fitbit data, survey data, and sleep advice. After the first week of enrollment, physicians reviewed Fitbit and survey data to provide sleep advice and selected 1 to 5 messages from a list of 23 options. We handcrafted physiological and behavioral features from the raw data and identified clusters of participants with similar characteristics using hierarchical clustering. We explored 3 models (random forest, light gradient-boosting machine, and CatBoost) and 3 data-balancing approaches (no balancing, random oversampling, and synthetic minority oversampling technique) to predict selections for the 7 most frequent advice messages related to bedroom brightness, smartphone use, and nap and sleep duration. We tested our predictions under participant-dependent and participant-independent settings and analyzed the most important features for prediction using permutation importance and Shapley additive explanations. ResultsWe found that the clusters were distinguished by work shifts and behavioral patterns. For example, one cluster had days with low sleep duration and the lowest sleep quality when there was a day shift on the day before and a midnight shift on the current day. Our advice prediction models achieved a higher area under the precision-recall curve than the baseline in all settings. The performance differences were statistically significant (P<.001 for 13 tests and P=.003 for 1 test). Sensitivity ranged from 0.50 to 1.00, and specificity varied between 0.44 and 0.93 across all advice messages and dataset split settings. Feature importance analysis of our models found several important features that matched the corresponding advice messages sent. For instance, for message 7 (darken the bedroom when you go to bed), the models primarily examined the average brightness of the sleep environment to make predictions. ConclusionsAlthough our current system requires physician input, an accurate machine learning algorithm shows promise for automatic advice without compromising the trustworthiness of the selected recommendations. Despite its decent performance, the algorithm is currently limited to the 7 most popular messages. Further studies are needed to enable predictions for less frequent advice labels.
more »
« less
- PAR ID:
- 10671881
- Publisher / Repository:
- JMIR Publications
- Date Published:
- Journal Name:
- JMIR Formative Research
- Volume:
- 9
- ISSN:
- 2561-326X
- Page Range / eLocation ID:
- e65000
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Background Shift work sleep disorders (SWSDs) are associated with the high turnover rates of nurses, and are considered a major medical safety issue. However, initial management can be hampered by insufficient awareness. In recent years, it has become possible to visualize, collect, and analyze the work-life balance of health care workers with irregular sleeping and working habits using wearable sensors that can continuously monitor biometric data under real-life settings. In addition, internet-based cognitive behavioral therapy for psychiatric disorders has been shown to be effective. Application of wearable sensors and machine learning may potentially enhance the beneficial effects of internet-based cognitive behavioral therapy. Objective In this study, we aim to develop and evaluate the effect of a new internet-based cognitive behavioral therapy for SWSD (iCBTS). This system includes current methods such as medical sleep advice, as well as machine learning well-being prediction to improve the sleep durations of shift workers and prevent declines in their well-being. Methods This study consists of two phases: (1) preliminary data collection and machine learning for well-being prediction; (2) intervention and evaluation of iCBTS for SWSD. Shift workers in the intensive care unit at Mie University Hospital will wear a wearable sensor that collects biometric data and answer daily questionnaires regarding their well-being. They will subsequently be provided with an iCBTS app for 4 weeks. Sleep and well-being measurements between baseline and the intervention period will be compared. Results Recruitment for phase 1 ended in October 2019. Recruitment for phase 2 has started in October 2020. Preliminary results are expected to be available by summer 2021. Conclusions iCBTS empowered with well-being prediction is expected to improve the sleep durations of shift workers, thereby enhancing their overall well-being. Findings of this study will reveal the potential of this system for improving sleep disorders among shift workers. Trial Registration UMIN Clinical Trials Registry UMIN000036122 (phase 1), UMIN000040547 (phase 2); https://tinyurl.com/dkfmmmje, https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000046284 International Registered Report Identifier (IRRID) DERR1-10.2196/24799more » « less
-
Female and under-represented minority students (URMs) in higher education disproportionately experience sleep disturbances. Incorporating sleep education and other psychological interventions (e.g., cognitive behavioral therapy for insomnia; CBT-I) into college settings might provide a scalable solution, but it is unknown whether such psychoeducational interventions produce equivalent outcomes across groups. We addressed this question with two approaches. First, we identified 36 US-based studies that had student participants and a psychoeducational sleep intervention. Fifteen authors shared data on sleep knowledge, quality, and/or duration separated by gender and URM groups (N = 599). Hedges’ g was computed for each group within each study. Second, we systematically reviewed the content of 21 available programs. We found that, relative to national collegiate data (59.4 % female, 41.5 % URM), females were over-represented (63.4 %) and URM groups were under-represented (23.7 %) in these studies. Interventions improved sleep knowledge (g = 0.69, p<.001) and sleep quality (g = 0.25, p<.001), but not sleep duration (g = 0.13, p = .18). Effect sizes were similar in males, females, URM students, and non-URM students. There were no studies that incorporated financial, social, or neighborhood-level barriers to sleep in students. Future interventions in student groups might be improved by combining individualized, CBT-I-based education while concomitantly addressing environmental/institutional barriers to sleep.more » « less
-
null (Ed.)Background With nearly 20% of the US adult population using fitness trackers, there is an increasing focus on how physiological data from these devices can provide actionable insights about workplace performance. However, in-the-wild studies that understand how these metrics correlate with cognitive performance measures across a diverse population are lacking, and claims made by device manufacturers are vague. While there has been extensive research leading to a variety of theories on how physiological measures affect cognitive performance, virtually all such studies have been conducted in highly controlled settings and their validity in the real world is poorly understood. Objective We seek to bridge this gap by evaluating prevailing theories on the effects of a variety of sleep, activity, and heart rate parameters on cognitive performance against data collected in real-world settings. Methods We used a Fitbit Charge 3 and a smartphone app to collect different physiological and neurobehavioral task data, respectively, as part of our 6-week-long in-the-wild study. We collected data from 24 participants across multiple population groups (shift workers, regular workers, and graduate students) on different performance measures (vigilant attention and cognitive throughput). Simultaneously, we used a fitness tracker to unobtrusively obtain physiological measures that could influence these performance measures, including over 900 nights of sleep and over 1 million minutes of heart rate and physical activity metrics. We performed a repeated measures correlation (rrm) analysis to investigate which sleep and physiological markers show association with each performance measure. We also report how our findings relate to existing theories and previous observations from controlled studies. Results Daytime alertness was found to be significantly correlated with total sleep duration on the previous night (rrm=0.17, P<.001) as well as the duration of rapid eye movement (rrm=0.12, P<.001) and light sleep (rrm=0.15, P<.001). Cognitive throughput, by contrast, was not found to be significantly correlated with sleep duration but with sleep timing—a circadian phase shift toward a later sleep time corresponded with lower cognitive throughput on the following day (rrm=–0.13, P<.001). Both measures show circadian variations, but only alertness showed a decline (rrm=–0.1, P<.001) as a result of homeostatic pressure. Both heart rate and physical activity correlate positively with alertness as well as cognitive throughput. Conclusions Our findings reveal that there are significant differences in terms of which sleep-related physiological metrics influence each of the 2 performance measures. This makes the case for more targeted in-the-wild studies investigating how physiological measures from self-tracking data influence, or can be used to predict, specific aspects of cognitive performance.more » « less
-
Abstract Study ObjectivesWe investigated the fidelity of conducting total sleep deprivation procedures outside of a controlled laboratory environment and the effects on sleepiness, stress/arousal, and learning outcomes. Materials and MethodsYoung adult participants wore sleep trackers for five days (n = 77; Mage = 19.78, 56.3% female, 55.6% white). After a baseline night, they were randomly assigned to control sleep versus total sleep deprivation conditions in their home setting. Participants in the total sleep deprivation condition were continuously monitored via web cameras and provided hourly reports on subjective sleepiness, lux exposure, and activities for one night. The next morning, participants completed stress/arousal assessments as well as a virtual lecture and immediate test on science concept learning. Following a 48-hour interval that included recovery sleep, participants repeated the subjective sleepiness, stress/arousal, and science concept test assessments. ResultsThere were low rates of withdrawal (4%) or dismissal (6%) due to non-adherence. Participants completed all hourly reports and sleep tracker data indicated high adherence to the assigned sleep condition (control sleep: M = 7.54 hours; sleep deprivation: M = 0.04 hours). Sleepiness significantly and progressively worsened following total sleep deprivation, and returned to baseline levels following recovery sleep. Sleep deprivation dampened perceived physiological arousal and impaired science concept learning; these outcomes occurred in the absence of significant changes to reported stress. Following recovery sleep, science concept test performance was similar across conditions. ConclusionsIn healthy young adults, total sleep deprivation procedures can be implemented with high-fidelity in home settings, conferring opportunities for greater ecological validity, larger sample sizes, and potentially more broadly generalizable outcomes.Statement of Significance Total sleep deprivation experiments have required continuous monitoring in a laboratory environment, which is expensive, burdensome, and low in ecological validity. The current work utilized web cameras, digital software, and mobile sleep tracking to demonstrate that sleep deprivation experiments can be conducted in participants’ home settings with high fidelity, adherence, and retention. Sleep deprivation caused worsening of sleepiness and educational learning, but recovery sleep returned these outcomes to baseline values. Though at-home sleep deprivation will not be appropriate for all research questions and study populations, this approach offers opportunities for efficient data collection of psychosocial, cognitive, and behavioral outcomes, larger sample sizes, and greater ecological validity. Furthermore, the remotely-monitored sleep deprivation approach may encourage new international collaborations for research groups across chrono-inverted time zones; this approach would allow daytime staff to monitor participants in their collaborator’s (night) time zone, thereby eliminating the need to work overnight shifts and broadening opportunities to investigate cross-cultural differences.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Journal Article:
- https://doi.org/10.2196/65000
