An official website of the United States government
Abstract ObjectiveTo develop predictive models of coronavirus disease 2019 (COVID-19) outcomes, elucidate the influence of socioeconomic factors, and assess algorithmic racial fairness using a racially diverse patient population with high social needs. Materials and MethodsData included 7,102 patients with positive (RT-PCR) severe acute respiratory syndrome coronavirus 2 test at a safety-net system in Massachusetts. Linear and nonlinear classification methods were applied. A score based on a recurrent neural network and a transformer architecture was developed to capture the dynamic evolution of vital signs. Combined with patient characteristics, clinical variables, and hospital occupancy measures, this dynamic vital score was used to train predictive models. ResultsHospitalizations can be predicted with an area under the receiver-operating characteristic curve (AUC) of 92% using symptoms, hospital occupancy, and patient characteristics, including social determinants of health. Parsimonious models to predict intensive care, mechanical ventilation, and mortality that used the most recent labs and vitals exhibited AUCs of 92.7%, 91.2%, and 94%, respectively. Early predictive models, using labs and vital signs closer to admission had AUCs of 81.1%, 84.9%, and 92%, respectively. DiscussionThe most accurate models exhibit racial bias, being more likely to falsely predict that Black patients will be hospitalized. Models that are only based on the dynamic vital score exhibited accuracies close to the best parsimonious models, although the latter also used laboratories. ConclusionsThis large study demonstrates that COVID-19 severity may accurately be predicted using a score that accounts for the dynamic evolution of vital signs. Further, race, social determinants of health, and hospital occupancy play an important role.
more »
« less
Social determinants of health and the prediction of missed breast imaging appointments
Abstract Background Predictive models utilizing social determinants of health (SDH), demographic data, and local weather data were trained to predict missed imaging appointments (MIA) among breast imaging patients at the Boston Medical Center (BMC). Patients were characterized by many different variables, including social needs, demographics, imaging utilization, appointment features, and weather conditions on the date of the appointment. Methods This HIPAA compliant retrospective cohort study was IRB approved. Informed consent was waived. After data preprocessing steps, the dataset contained 9,970 patients and 36,606 appointments from 1/1/2015 to 12/31/2019. We identified 57 potentially impactful variables used in the initial prediction model and assessed each patient for MIA. We then developed a parsimonious model via recursive feature elimination, which identified the 25 most predictive variables. We utilized linear and non-linear models including support vector machines (SVM), logistic regression (LR), and random forest (RF) to predict MIA and compared their performance. Results The highest-performing full model is the nonlinear RF, achieving the highest Area Under the ROC Curve (AUC) of 76% and average F1 score of 85%. Models limited to the most predictive variables were able to attain AUC and F1 scores comparable to models with all variables included. The variables most predictive of missed appointments included timing, prior appointment history, referral department of origin, and socioeconomic factors such as household income and access to caregiving services. Conclusions Prediction of MIA with the data available is inherently limited by the complex, multifactorial nature of MIA. However, the algorithms presented achieved acceptable performance and demonstrated that socioeconomic factors were useful predictors of MIA. In contrast with non-modifiable demographic factors, we can address SDH to decrease the incidence of MIA.
more »
« less
- PAR ID:
- 10424876
- Date Published:
- Journal Name:
- BMC Health Services Research
- Volume:
- 22
- Issue:
- 1
- ISSN:
- 1472-6963
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract BackgroundNeglected tropical diseases affect the most vulnerable populations and cause chronic and debilitating disorders. Socioeconomic vulnerability is a well-known and important determinant of neglected tropical diseases. For example, poverty and sanitation could influence parasite transmission. Nevertheless, the quantitative impact of socioeconomic conditions on disease transmission risk remains poorly explored. MethodsThis study investigated the role of socioeconomic variables in the predictive capacity of risk models of neglected tropical zoonoses using a decade of epidemiological data (2007–2018) from Brazil. Vector-borne diseases investigated in this study included dengue, malaria, Chagas disease, leishmaniasis, and Brazilian spotted fever, while directly-transmitted zoonotic diseases included schistosomiasis, leptospirosis, and hantaviruses. Environmental and socioeconomic predictors were combined with infectious disease data to build environmental and socioenvironmental sets of ecological niche models and their performances were compared. ResultsSocioeconomic variables were found to be as important as environmental variables in influencing the estimated likelihood of disease transmission across large spatial scales. The combination of socioeconomic and environmental variables improved overall model accuracy (or predictive power) by 10% on average (P < 0.01), reaching a maximum of 18% in the case of dengue fever. Gross domestic product was the most important socioeconomic variable (37% relative variable importance, all individual models exhibitedP < 0.00), showing a decreasing relationship with disease indicating poverty as a major factor for disease transmission. Loss of natural vegetation cover between 2008 and 2018 was the most important environmental variable (42% relative variable importance,P < 0.05) among environmental models, exhibiting a decreasing relationship with disease probability, showing that these diseases are especially prevalent in areas where natural ecosystem destruction is on its initial stages and lower when ecosystem destruction is on more advanced stages. ConclusionsDestruction of natural ecosystems coupled with low income explain macro-scale neglected tropical and zoonotic disease probability in Brazil. Addition of socioeconomic variables improves transmission risk forecasts on tandem with environmental variables. Our results highlight that to efficiently address neglected tropical diseases, public health strategies must target both reduction of poverty and cessation of destruction of natural forests and savannas.more » « less
-
Abstract The strain on healthcare resources brought forth by the recent COVID-19 pandemic has highlighted the need for efficient resource planning and allocation through the prediction of future consumption. Machine learning can predict resource utilization such as the need for hospitalization based on past medical data stored in electronic medical records (EMR). We conducted this study on 3194 patients (46% male with mean age 56.7 (±16.8), 56% African American, 7% Hispanic) flagged as COVID-19 positive cases in 12 centers under Emory Healthcare network from February 2020 to September 2020, to assess whether a COVID-19 positive patient’s need for hospitalization can be predicted at the time of RT-PCR test using the EMR data prior to the test. Five main modalities of EMR, i.e., demographics, medication, past medical procedures, comorbidities, and laboratory results, were used as features for predictive modeling, both individually and fused together using late, middle, and early fusion. Models were evaluated in terms of precision, recall, F1-score (within 95% confidence interval). The early fusion model is the most effective predictor with 84% overall F1-score [CI 82.1–86.1]. The predictive performance of the model drops by 6 % when using recent clinical data while omitting the long-term medical history. Feature importance analysis indicates that history of cardiovascular disease, emergency room visits in the past year prior to testing, and demographic factors are predictive of the disease trajectory. We conclude that fusion modeling using medical history and current treatment data can forecast the need for hospitalization for patients infected with COVID-19 at the time of the RT-PCR test.more » « less
-
We performed various analyses on the taxonomic and functional features of the gut microbiome from NSCLC patients treated with immunotherapy to establish a model that may predict whether a patient will benefit from immunotherapy. We collected 65 published whole metagenome shotgun sequencing samples along with 14 samples from our previous study. We systematically studied the taxonomical characteristics of the dataset and used both the random forest (RF) and the multilayer perceptron (MLP) neural network models to predict patients with progression-free survival (PFS) above 6 months versus those below 3 months. Our results showed that the RF classifier achieved the highest F-score (85.2%) and the area under the receiver operating characteristic curve (AUC) (95%) using the protein families (Pfam) profile, and the MLP neural network classifier achieved a 99.9% F-score and 100% AUC using the same Pfam profile. When applying the model trained in the Pfam profile directly to predict the treatment response, we found that both trained RF and MLP classifiers significantly outperformed the stochastic predictor in F-score. Our results suggested that such a predictive model based on functional (e.g., Pfam) rather than taxonomic profile might be clinically useful to predict whether an NSCLC patient will benefit from immunotherapy, as both the F-score and AUC of functional profile outperform that of taxonomic profile. In addition, our model suggested that interactive biological processes such as methanogenesis, one-carbon, and amino acid metabolism might be important in regulating the immunotherapy response that warrants further investigation.more » « less
-
Introduction: New financial incentives, such as reduced Medicare reimbursements, have led hospitals to closely monitor their readmission rates and initiate efforts aimed at reducing them. In this context, many surgical departments participate in the American College of Surgeons National Surgical Quality Improvement Program (NSQIP), which collects detailed demographic, laboratory, clinical, procedure and perioperative occurrence data. The availability of such data enables the development of data science methods which predict readmissions and, as done in this paper, offer specific recommendations aimed at preventing readmissions. Materials and Methods: This study leverages NSQIP data for 722,101 surgeries to develop predictive and prescriptive models, predicting readmissions and offering real-time, personalized treatment recommendations for surgical patients during their hospital stay, aimed at reducing the risk of a 30-day readmission. We applied a variety of classification methods to predict 30-day readmissions and developed two prescriptive methods to recommend pre-operative blood transfusions to increase the patient’s hematocrit with the objective of preventing readmissions. The effect of these interventions was evaluated using several predictive models. Results: Predictions of 30-day readmissions based on the entire collection of NSQIP variables achieve an out-of-sample accuracy of 87% (Area Under the Curve—AUC). Predictions based only on pre-operative variables have an accuracy of 74% AUC, out-of-sample. Personalized interventions, in the form of pre-operative blood transfusions identified by the prescriptive methods, reduce readmissions by 12%, on average, for patients considered as candidates for pre-operative transfusion (pre-operative hematoctic <30). The prediction accuracy of the proposed models exceeds results in the literature. Conclusions: This study is among the first to develop a methodology for making specific, data-driven, personalized treatment recommendations to reduce the 30-day readmission rate. The reported predicted reduction in readmissions can lead to more than $20 million in savings in the U.S. annually.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1186/s12913-022-08784-8
