skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Comparing machine and deep learning‐based algorithms for prediction of clinical improvement in psychosis with functional magnetic resonance imaging
Abstract Previous work using logistic regression suggests that cognitive control‐related frontoparietal activation in early psychosis can predict symptomatic improvement after 1 year of coordinated specialty care with 66% accuracy. Here, we evaluated the ability of six machine learning (ML) algorithms and deep learning (DL) to predict “Improver” status (>20% improvement on Brief Psychiatric Rating Scale [BPRS] total score at 1‐year follow‐up vs. baseline) and continuous change in BPRS score using the same functional magnetic resonance imaging‐based features (frontoparietal activations during the AX‐continuous performance task) in the same sample (individuals with either schizophrenia (n =65, 49M/16F, mean age 20.8 years) or Type I bipolar disorder (n= 17, 9M/8F, mean age 21.6 years)). 138 healthy controls were included as a reference group. “Shallow” ML methods included Naive Bayes, support vector machine, K Star, AdaBoost, J48 decision tree, and random forest. DL included an explainable artificial intelligence (XAI) procedure for understanding results. The best overall performances (70% accuracy for the binary outcome and root mean square error = 9.47 for the continuous outcome) were achieved using DL. XAI revealed left DLPFC activation was the strongest feature used to make binary classification decisions, with a classification activation threshold (adjusted beta = .017) intermediate to the healthy control mean (adjusted beta = .15, 95% CI = −0.02 to 0.31) and patient mean (adjusted beta = −.13, 95% CI = −0.37 to 0.11). Our results suggest DL is more powerful than shallow ML methods for predicting symptomatic improvement. The left DLPFC may be a functional target for future biomarker development as its activation was particularly important for predicting improvement.  more » « less
Award ID(s):
1910306
PAR ID:
10453308
Author(s) / Creator(s):
 ;  ;  
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Human Brain Mapping
Volume:
42
Issue:
4
ISSN:
1065-9471
Page Range / eLocation ID:
p. 1197-1205
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ImportanceScreening with low-dose computed tomography (CT) has been shown to reduce mortality from lung cancer in randomized clinical trials in which the rate of adherence to follow-up recommendations was over 90%; however, adherence to Lung Computed Tomography Screening Reporting & Data System (Lung-RADS) recommendations has been low in practice. Identifying patients who are at risk of being nonadherent to screening recommendations may enable personalized outreach to improve overall screening adherence. ObjectiveTo identify factors associated with patient nonadherence to Lung-RADS recommendations across multiple screening time points. Design, Setting, and ParticipantsThis cohort study was conducted at a single US academic medical center across 10 geographically distributed sites where lung cancer screening is offered. The study enrolled individuals who underwent low-dose CT screening for lung cancer between July 31, 2013, and November 30, 2021. ExposuresLow-dose CT screening for lung cancer. Main Outcomes and MeasuresThe main outcome was nonadherence to follow-up recommendations for lung cancer screening, defined as failing to complete a recommended or more invasive follow-up examination (ie, diagnostic dose CT, positron emission tomography–CT, or tissue sampling vs low-dose CT) within 15 months (Lung-RADS score, 1 or 2), 9 months (Lung-RADS score, 3), 5 months (Lung-RADS score, 4A), or 3 months (Lung-RADS score, 4B/X). Multivariable logistic regression was used to identify factors associated with patient nonadherence to baseline Lung-RADS recommendations. A generalized estimating equations model was used to assess whether the pattern of longitudinal Lung-RADS scores was associated with patient nonadherence over time. ResultsAmong 1979 included patients, 1111 (56.1%) were aged 65 years or older at baseline screening (mean [SD] age, 65.3 [6.6] years), and 1176 (59.4%) were male. The odds of being nonadherent were lower among patients with a baseline Lung-RADS score of 1 or 2 vs 3 (adjusted odds ratio [AOR], 0.35; 95% CI, 0.25-0.50), 4A (AOR, 0.21; 95% CI, 0.13-0.33), or 4B/X, (AOR, 0.10; 95% CI, 0.05-0.19); with a postgraduate vs college degree (AOR, 0.70; 95% CI, 0.53-0.92); with a family history of lung cancer vs no family history (AOR, 0.74; 95% CI, 0.59-0.93); with a high age-adjusted Charlson Comorbidity Index score (≥4) vs a low score (0 or 1) (AOR, 0.67; 95% CI, 0.46-0.98); in the high vs low income category (AOR, 0.79; 95% CI, 0.65-0.98); and referred by physicians from pulmonary or thoracic-related departments vs another department (AOR, 0.56; 95% CI, 0.44-0.73). Among 830 eligible patients who had completed at least 2 screening examinations, the adjusted odds of being nonadherent to Lung-RADS recommendations at the following screening were increased in patients with consecutive Lung-RADS scores of 1 to 2 (AOR, 1.38; 95% CI, 1.12-1.69). Conclusions and RelevanceIn this retrospective cohort study, patients with consecutive negative lung cancer screening results were more likely to be nonadherent with follow-up recommendations. These individuals are potential candidates for tailored outreach to improve adherence to recommended annual lung cancer screening. 
    more » « less
  2. ImportanceConsequences of subconcussive head impacts have been recognized, yet most studies to date have included small samples from a single site, used a unimodal approach, and lacked repeated testing. ObjectiveTo examine time-course changes in clinical (near point of convergence [NPC]) and brain-injury blood biomarkers (glial fibrillary acidic protein [GFAP], ubiquitin C-terminal hydrolase-L1 [UCH-L1], and neurofilament light [NF-L]) in adolescent football players and to test whether changes in the outcomes were associated with playing position, impact kinematics, and/or brain tissue strain. Design, Setting, and ParticipantsThis multisite, prospective cohort study included male high school football players aged 13 to 18 years at 4 high schools in the Midwest during the 2021 high school football season (preseason [July] and August 2 to November 19). ExposureA single football season. Main Outcomes and MeasuresThe main outcomes were NPC (a clinical oculomotor test) and serum levels of GFAP, UCH-L1, and NF-L. Participants’ head impact exposure (frequency and peak linear and rotational accelerations) was tracked using instrumented mouthguards, and maximum principal strain was computed to reflect brain tissue strain. Players’ neurological function was assessed at 5 time points (preseason, post–training camp, 2 in season, and postseason). ResultsNinety-nine male players contributed to the time-course analysis (mean [SD] age, 15.8 [1.1] years), but data from 6 players (6.1%) were excluded from the association analysis due to issues related to mouthguards. Thus, 93 players yielded 9498 head impacts in a season (mean [SD], 102 [113] impacts per player). There were time-course elevations in NPC and GFAP, UCH-L1, and NF-L levels. Compared with baseline, the NPC exhibited a significant elevation over time and peaked at postseason (2.21 cm; 95% CI, 1.80-2.63 cm;P < .001). Levels of GFAP and UCH-L1 increased by 25.6 pg/mL (95% CI, 17.6-33.6 pg/mL;P < .001) and 188.5 pg/mL (95% CI, 145.6-231.4 pg/mL;P < .001), respectively, later in the season. Levels of NF-L were elevated after the training camp (0.78 pg/mL; 95% CI, 0.14-1.41 pg/mL;P = .011) and midseason (0.55 pg/mL; 95% CI, 0.13-0.99 pg/mL;P = .006) but normalized by the end of the season. Changes in UCH-L1 levels were associated with maximum principal strain later in the season (0.052 pg/mL; 95% CI, 0.015-0.088 pg/mL;P = .007) and postseason (0.069 pg/mL; 95% CI, 0.031-0.106 pg/mL;P < .001). Conclusions and RelevanceThe study data suggest that adolescent football players exhibited impairments in oculomotor function and elevations in blood biomarker levels associated with astrocyte activation and neuronal injury throughout a season. Several years of follow-up are needed to examine the long-term effects of subconcussive head impacts in adolescent football players. 
    more » « less
  3. Abstract The human spleen contracts in response to stress‐induced catecholamine secretion, resulting in a temporary rise in haemoglobin concentration ([Hb]). Recent findings highlighted enhanced splenic response to exercise at high altitude in Sherpa, possibly due to a blunted splenic response to hypoxia. To explore the potential blunted splenic contraction in Sherpas at high altitude, we examined changes in spleen volume during hyperoxic breathing, comparing acclimatized Sherpa with acclimatized individuals of lowland ancestry. Our study included 14 non‐Sherpa (7 female) residing at altitude for a mean continuous duration of 3 months and 46 Sherpa (24 female) with an average of 4 years altitude exposure. Participants underwent a hyperoxic breathing test at altitude (4300 m; barrometric pressure = ∼430 torr;  = ∼90 torr). Throughout the test, we measured spleen volume using ultrasonography and monitored oxygen saturation (). During rest, Sherpa exhibited larger spleens (226 ± 70 mL) compared to non‐Sherpa (165 ± 34 mL;P < 0.001; effect size (ES) = 0.95, 95% CI: 0.3–1.6). In response to hyperoxia, non‐Sherpa demonstrated 22 ± 12% increase in spleen size (35 ± 17 mL, 95% CI: 20.7–48.9;P < 0.001; ES = 1.8, 95% CI: 0.93–2.66), while spleen size remained unchanged in Sherpa (−2 ± 13 mL, 95% CI: −2.4 to 7.3;P = 0.640; ES = 0.18, 95% CI: −0.10 to 0.47). Our findings suggest that Sherpa and non‐Sherpas of lowland ancestry exhibit distinct variations in spleen volume during hyperoxia at high altitude, potentially indicating two distinct splenic functions. In Sherpa, this phenomenon may signify a diminished splenic response to altitude‐related hypoxia at rest, potentially contributing to enhanced splenic contractions during physical stress. Conversely, non‐Sherpa experienced a transient increase in spleen size during hyperoxia, indicating an active tonic contraction, which may influence early altitude acclimatization in lowlanders by raising [Hb]. 
    more » « less
  4. ImportanceThe COVID-19 pandemic has been notable for the widespread dissemination of misinformation regarding the virus and appropriate treatment. ObjectiveTo quantify the prevalence of non–evidence-based treatment for COVID-19 in the US and the association between such treatment and endorsement of misinformation as well as lack of trust in physicians and scientists. Design, Setting, and ParticipantsThis single-wave, population-based, nonprobability internet survey study was conducted between December 22, 2022, and January 16, 2023, in US residents 18 years or older who reported prior COVID-19 infection. Main Outcome and MeasureSelf-reported use of ivermectin or hydroxychloroquine, endorsing false statements related to COVID-19 vaccination, self-reported trust in various institutions, conspiratorial thinking measured by the American Conspiracy Thinking Scale, and news sources. ResultsA total of 13 438 individuals (mean [SD] age, 42.7 [16.1] years; 9150 [68.1%] female and 4288 [31.9%] male) who reported prior COVID-19 infection were included in this study. In this cohort, 799 (5.9%) reported prior use of hydroxychloroquine (527 [3.9%]) or ivermectin (440 [3.3%]). In regression models including sociodemographic features as well as political affiliation, those who endorsed at least 1 item of COVID-19 vaccine misinformation were more likely to receive non–evidence-based medication (adjusted odds ratio [OR], 2.86; 95% CI, 2.28-3.58). Those reporting trust in physicians and hospitals (adjusted OR, 0.74; 95% CI, 0.56-0.98) and in scientists (adjusted OR, 0.63; 95% CI, 0.51-0.79) were less likely to receive non–evidence-based medication. Respondents reporting trust in social media (adjusted OR, 2.39; 95% CI, 2.00-2.87) and in Donald Trump (adjusted OR, 2.97; 95% CI, 2.34-3.78) were more likely to have taken non–evidence-based medication. Individuals with greater scores on the American Conspiracy Thinking Scale were more likely to have received non–evidence-based medications (unadjusted OR, 1.09; 95% CI, 1.06-1.11; adjusted OR, 1.10; 95% CI, 1.07-1.13). Conclusions and RelevanceIn this survey study of US adults, endorsement of misinformation about the COVID-19 pandemic, lack of trust in physicians or scientists, conspiracy-mindedness, and the nature of news sources were associated with receiving non–evidence-based treatment for COVID-19. These results suggest that the potential harms of misinformation may extend to the use of ineffective and potentially toxic treatments in addition to avoidance of health-promoting behaviors. 
    more » « less
  5. Abstract During the Coronavirus Disease 2019 (COVID-19) epidemic, many health professionals used social media to promote preventative health behaviors. We conducted a randomized controlled trial of the effect of a Facebook advertising campaign consisting of short videos recorded by doctors and nurses to encourage users to stay at home for the Thanksgiving and Christmas holidays ( NCT04644328 and AEARCTR-0006821 ). We randomly assigned counties to high intensity ( n  = 410 (386) at Thanksgiving (Christmas)) or low intensity ( n  = 410 (381)). The intervention was delivered to a large fraction of Facebook subscribers in 75% and 25% of randomly assigned zip codes in high- and low-intensity counties, respectively. In total, 6,998 (6,716) zip codes were included, and 11,954,109 (23,302,290) users were reached at Thanksgiving (Christmas). The first two primary outcomes were holiday travel and fraction leaving home, both measured using mobile phone location data of Facebook users. Average distance traveled in high-intensity counties decreased by −0.993 percentage points (95% confidence interval (CI): –1.616, −0.371; P = 0.002) for the 3 days before each holiday compared to low-intensity counties. The fraction of people who left home on the holiday was not significantly affected (adjusted difference: 0.030; 95% CI: −0.361, 0.420; P = 0.881). The third primary outcome was COVID-19 infections recorded at the zip code level in the 2-week period starting 5 days after the holiday. Infections declined by 3.5% (adjusted 95% CI: −6.2%, −0.7%; P = 0.013) in intervention compared to control zip codes. Social media messages recorded by health professionals before the winter holidays in the United States led to a significant reduction in holiday travel and subsequent COVID-19 infections. 
    more » « less