skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Evaluating the Use of Online Self-Report Questionnaires as Clinically Valid Mental Health Monitoring Tools in the Clinical Whitespace
Abstract Although digital health solutions are increasingly popular in clinical psychiatry, one application that has not been fully explored is the utilization of survey technology to monitor patients outside of the clinic. Supplementing routine care with digital information collected in the “clinical whitespace” between visits could improve care for patients with severe mental illness. This study evaluated the feasibility and validity of using online self-report questionnaires to supplement in-person clinical evaluations in persons with and without psychiatric diagnoses. We performed a rigorous in-person clinical diagnostic and assessment battery in 54 participants with schizophrenia (N = 23), depressive disorder (N = 14), and healthy controls (N = 17) using standard assessments for depressive and psychotic symptomatology. Participants were then asked to complete brief online assessments of depressive (Quick Inventory of Depressive Symptomatology) and psychotic (Community Assessment of Psychic Experiences) symptoms outside of the clinic for comparison with the ground-truth in-person assessments. We found that online self-report ratings of severity were significantly correlated with the clinical assessments for depression (two assessments used: R = 0.63, p < 0.001; R = 0.73, p < 0.001) and psychosis (R = 0.62, p < 0.001). Our results demonstrate the feasibility and validity of collecting psychiatric symptom ratings through online surveys. Surveillance of this kind may be especially useful in detecting acute mental health crises between patient visits and can generally contribute to more comprehensive psychiatric treatment.  more » « less
Award ID(s):
2124270
PAR ID:
10411770
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
Psychiatric Quarterly
Volume:
94
Issue:
2
ISSN:
0033-2720
Format(s):
Medium: X Size: p. 221-231
Size(s):
p. 221-231
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Over the last ten years, there has been considerable progress in using digital behavioral phenotypes, captured passively and continuously from smartphones and wearable devices, to infer depressive mood. However, most digital phenotype studies suffer from poor replicability, often fail to detect clinically relevant events, and use measures of depression that are not validated or suitable for collecting large and longitudinal data. Here, we report high-quality longitudinal validated assessments of depressive mood from computerized adaptive testing paired with continuous digital assessments of behavior from smartphone sensors for up to 40 weeks on 183 individuals experiencing mild to severe symptoms of depression. We apply a combination of cubic spline interpolation and idiographic models to generate individualized predictions of future mood from the digital behavioral phenotypes, achieving high prediction accuracy of depression severity up to three weeks in advance (R2≥ 80%) and a 65.7% reduction in the prediction error over a baseline model which predicts future mood based on past depression severity alone. Finally, our study verified the feasibility of obtaining high-quality longitudinal assessments of mood from a clinical population and predicting symptom severity weeks in advance using passively collected digital behavioral data. Our results indicate the possibility of expanding the repertoire of patient-specific behavioral measures to enable future psychiatric research. 
    more » « less
  2. Introduction:The Virtual Diabetes Specialty Clinic (VDiSC) study demonstrated the feasibility of providing comprehensive diabetes care entirely virtually by combining virtual visits with continuous glucose monitoring support and remote patient monitoring (RPM). However, the financial sustainability of this model remains uncertain. Methods:We developed a financial model to estimate the variable costs and revenues of virtual diabetes care, using visit data from the 234 VDiSC participants with type 1 or type 2 diabetes. Data included virtual visits with certified diabetes care and education specialists (CDCES), endocrinologists, and behavioral health services (BHS). The model estimated care utilization, variable costs, reimbursement revenue, gross profit, and gross profit margin per member, per month (PMPM) for privately insured, publicly insured, and overall clinic populations (75% privately insured). We performed two-way sensitivity analyses on key parameters. Results:Gross profit and gross profit margin PMPM (95% confidence interval) were estimated at $−4 ($−14.00 to $5.68) and −4% (−3% to −6%) for publicly insured patients; $267.26 ($256.59-$277.93) and 73% (58%-88%) for privately insured patients; and $199.41 ($58.43-$340.39) and 67% (32%-102%) for the overall clinic. Profits were primarily driven by CDCES visits and RPM. Results were sensitive to insurance mix, cost-to-charge ratio, and commercial-to-Medicare price ratio. Conclusions:Virtual diabetes care can be financially viable, although profitability relies on privately insured patients. The analysis excluded fixed costs of clinic infrastructure, and securing reimbursement may be challenging in practice. The financial model is adaptable to various care settings and can serve as a planning tool for virtual diabetes clinics. 
    more » « less
  3. Abstract The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians’ after-hours clinical work (work-outside-work”). The surge in patients’ digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians’ after-hours commitments. We examined the impact on physicians’ workload from two types of digital demands - patients’ messages requesting medical advice (PMARs) sent to physicians’ inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect ofPMARs on physicians’ work-outside-work and that this relationship is moderated by physicians’ specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewerPMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increasedPMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. ReducingPMARvolumes and efficient inbasket management strategies needed to reduce physicians’ work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services. 
    more » « less
  4. Despite providing convenience and reducing the travel burden of patients, Video-Conferencing (VC) clinical visits have not enjoyed wide uptake by patients and care providers. It is desired that the medical problems addressed by VC visits can match a face-to-face encounter in scope and quality. Subsequently, VC visits with nurse assistance are emerging; however, the scalable and financially sustainable of such services are unclear. Therefore, we explore the implementability of VC visits with nursing services using a game-theoretic model, and investigate the impact of different pricing schemes (discriminative pricing based on patient characteristics vs. non-discriminative) on patients’ care choices between VC and in-person visits. Our results shed light on the “artificial congestion” created by a profit-driven medical institution that hurts patient welfare, and subsequently identify the conditions where the interest of the social planner and the medical institution are aligned. Our results highlight that, compared to a uniform price of VC visits which seems fair, discriminative pricing can be more beneficial for patients and the medical institution alike. This heightens the importance of insurance coverage of telehealth-related services to promote the adoption of telehealth by patients and care providers, and ultimately, improving care access and patient outcomes. 
    more » « less
  5. ABSTRACT ObjectivesMost bipolar disorder (BD) patients initially present with depressive symptoms, resulting in a delayed diagnosis of BD and poor clinical outcomes. This study aims to identify features predictive of the conversion from Major Depressive Disorder (MDD) to BD by leveraging electronic health record (EHR) data from the Clínica San Juan de Dios Manizales in Colombia. MethodsWe employed a multivariable Cox regression model to identify important predictors of conversion from MDD to BD. ResultsAnalyzing 15 years of EHR data from 13,607 patients diagnosed with MDD, a total of 1610 (11.8%) transitioned to BD. Predictive features of the conversion to BD included severity of the initial MDD episode, presence of psychosis and hospitalization at first episode, family history of BD, and female gender. Additionally, we observed associations with medication classes (positive associations with prescriptions of mood stabilizers, antipsychotics, and negative associations with antidepressants) and a positive association with suicidality, a feature derived from natural language processing (NLP) of clinical notes. Together, these risk factors predicted BD conversion within 5 years of the initial MDD diagnosis, with a recall of 72% and a precision of 38%. ConclusionsOur study confirms previously identified risk factors identified through registry‐based studies (female gender and psychotic depression at the index MDD episode) and identifies novel ones (suicidality extracted from clinical notes). These results simultaneously demonstrate the validity of using EHR data for predicting BD conversion and underscore its potential for the identification of novel risk factors, thereby improving early diagnosis. 
    more » « less