An official website of the United States government
The burgeoning field of brain health research increasingly leverages artificial intelligence (AI) to analyze and interpret neuroimaging data. Medical foundation models have shown promise of superior performance with better sample efficiency. This work introduces a novel approach towards creating 3-dimensional (3D) medical foundation models for multimodal neuroimage segmentation through self-supervised training. Our approach involves a novel two-stage pretraining approach using vision transformers. The first stage encodes anatomical structures in generally healthy brains from the large-scale unlabeled neuroimage dataset of multimodal brain magnetic resonance imaging (MRI) images from 41,400 participants. This stage of pertaining focuses on identifying key features such as shapes and sizes of different brain structures. The second pretraining stage identifies disease-specific attributes, such as geometric shapes of tumors and lesions and spatial placements within the brain. This dual-phase methodology significantly reduces the extensive data requirements usually necessary for AI model training in neuroimage segmentation with the flexibility to adapt to various imaging modalities. We rigorously evaluate our model, BrainSegFounder, using the Brain Tumor Segmentation (BraTS) challenge and Anatomical Tracings of Lesions After Stroke v2.0 (ATLAS v2.0) datasets. BrainSegFounder demonstrates a significant performance gain, surpassing the achievements of the previous winning solutions using fully supervised learning. Our findings underscore the impact of scaling up both the model complexity and the volume of unlabeled training data derived from generally healthy brains. Both of these factors enhance the accuracy and predictive capabilities of the model in neuroimage segmentation tasks. Our pretrained models and code are at https://github.com/lab-smile/BrainSegFounder.
more »
« less
Assessment of brain cancer atlas maps with multimodal imaging features
Abstract Background Glioblastoma Multiforme (GBM) is a fast-growing and highly aggressive brain tumor that invades the nearby brain tissue and presents secondary nodular lesions across the whole brain but generally does not spread to distant organs. Without treatment, GBM can result in death in about 6 months. The challenges are known to depend on multiple factors: brain localization, resistance to conventional therapy, disrupted tumor blood supply inhibiting effective drug delivery, complications from peritumoral edema, intracranial hypertension, seizures, and neurotoxicity. Main text Imaging techniques are routinely used to obtain accurate detections of lesions that localize brain tumors. Especially magnetic resonance imaging (MRI) delivers multimodal images both before and after the administration of contrast, which results in displaying enhancement and describing physiological features as hemodynamic processes. This review considers one possible extension of the use of radiomics in GBM studies, one that recalibrates the analysis of targeted segmentations to the whole organ scale. After identifying critical areas of research, the focus is on illustrating the potential utility of an integrated approach with multimodal imaging, radiomic data processing and brain atlases as the main components. The templates associated with the outcome of straightforward analyses represent promising inference tools able to spatio-temporally inform on the GBM evolution while being generalizable also to other cancers. Conclusions The focus on novel inference strategies applicable to complex cancer systems and based on building radiomic models from multimodal imaging data can be well supported by machine learning and other computational tools potentially able to translate suitably processed information into more accurate patient stratifications and evaluations of treatment efficacy. Graphical Abstract
more »
« less
- Award ID(s):
- 2313443
- PAR ID:
- 10435811
- Date Published:
- Journal Name:
- Journal of Translational Medicine
- Volume:
- 21
- Issue:
- 1
- ISSN:
- 1479-5876
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract BackgroundGlioblastoma Multiforme, an aggressive primary brain tumor, has a poor prognosis and no effective standard of care treatments. Most patients undergoing radiotherapy, along with Temozolomide chemotherapy, develop resistance to the drug, and recurrence of the tumor is a common issue after the treatment. We propose to model the pathways active in Glioblastoma using Boolean network techniques. The network captures the genetic interactions and possible mutations that are involved in the development of the brain tumor. The model is used to predict the theoretical efficacies of drugs for the treatment of cancer. ResultsWe use the Boolean network to rank the critical intervention points in the pathway to predict an effective therapeutic strategy for Glioblastoma. Drug repurposing helps to identify non-cancer drugs that could be effective in cancer treatment. We predict the effectiveness of drug combinations of anti-cancer and non-cancer drugs for Glioblastoma. ConclusionsGiven the genetic profile of a GBM tumor, the Boolean model can predict the most effective targets for treatment. We also identified two-drug combinations that could be more effective in killing GBM cells than conventional chemotherapeutic agents. The non-cancer drug Aspirin could potentially increase the cytotoxicity of TMZ in GBM patients.more » « less
-
Abstract Glioblastoma (GBM) is hard to treat due to cellular invasion into functioning brain tissues, limited drug delivery, and evolved treatment resistance. Recurrence is nearly universal even after surgery, chemotherapy, and radiation. Photodynamic therapy (PDT) involves photosensitizer administration followed by light activation to generate reactive oxygen species at tumor sites, thereby killing cells or inducing biological changes. PDT can ablate unresectable GBM and sensitize tumors to chemotherapy. Verteporfin (VP) is a promising photosensitizer that relies on liposomal carriers for clinical use. While lipids increase VP's solubility, they also reduce intracellular photosensitizer accumulation. Here, a pure‐drug nanoformulation of VP, termed “NanoVP”, eliminating the need for lipids, excipients, or stabilizers is reported. NanoVP has a tunable size (65–150 nm) and 1500‐fold higher photosensitizer loading capacity than liposomal VP. NanoVP shows a 2‐fold increase in photosensitizer uptake and superior PDT efficacy in GBM cells compared to liposomal VP. In mouse models, NanoVP‐PDT improved tumor control and extended animal survival, outperforming liposomal VP and 5‐aminolevulinic acid (5‐ALA). Moreover, low‐dose NanoVP‐PDT can safely open the blood‐brain barrier, increasing drug accumulation in rat brains by 5.5‐fold compared to 5‐ALA. NanoVP is a new photosensitizer formulation that has the potential to facilitate PDT for the treatment of GBM.more » « less
-
null (Ed.)Glioblastoma (GBM) is one of the most aggressive forms of adult brain cancers and is highly resistant to treatment, with a median survival of 12–18 months after diagnosis. The poor survival is due to its infiltrative pattern of invasion into the normal brain parenchyma, the diffuse nature of its growth, and its ability to quickly grow, spread, and relapse. Temozolomide is a well-known FDA-approved alkylating chemotherapy agent used for the treatment of high-grade malignant gliomas, and it has been shown to improve overall survival. However, in most cases, the tumor relapses. In recent years, CAP has been used as an emerging technology for cancer therapy. The purpose of this study was to implement a combination therapy of CAP and TMZ to enhance the effect of TMZ and apparently sensitize GBMs. In vitro evaluations in TMZ-sensitive and resistant GBM cell lines established a CAP chemotherapy enhancement and potential sensitization effect across various ranges of CAP jet application. This was further supported with in vivo findings demonstrating that a single CAP jet applied non-invasively through the skull potentially sensitizes GBM to subsequent treatment with TMZ. Gene functional enrichment analysis further demonstrated that co-treatment with CAP and TMZ resulted in a downregulation of cell cycle pathway genes. These observations indicate that CAP can be potentially useful in sensitizing GBM to chemotherapy and for the treatment of glioblastoma as a non-invasive translational therapy.more » « less
-
Abstract Glioblastoma (GBM) is an aggressive primary brain cancer that currently has minimally effective treatments. Like other cancers, immunosuppression by the PD-L1-PD-1 immune checkpoint complex is a prominent axis by which glioma cells evade the immune system. Myeloid-derived suppressor cells (MDSCs), which are recruited to the glioma microenviroment, also contribute to the immunosuppressed GBM microenvironment by suppressing T cell functions. In this paper, we propose a GBM-specific tumor-immune ordinary differential equations model of glioma cells, T cells, and MDSCs to provide theoretical insights into the interactions between these cells. Equilibrium and stability analysis indicates that there are unique tumorous and tumor-free equilibria which are locally stable under certain conditions. Further, the tumor-free equilibrium is globally stable when T cell activation and the tumor kill rate by T cells overcome tumor growth, T cell inhibition by PD-L1-PD-1 and MDSCs, and the T cell death rate. Bifurcation analysis suggests that a treatment plan that includes surgical resection and therapeutics targeting immune suppression caused by the PD-L1-PD1 complex and MDSCs results in the system tending to the tumor-free equilibrium. Using a set of preclinical experimental data, we implement the approximate Bayesian computation (ABC) rejection method to construct probability density distributions that estimate model parameters. These distributions inform an appropriate search curve for global sensitivity analysis using the extended fourier amplitude sensitivity test. Sensitivity results combined with the ABC method suggest that parameter interaction is occurring between the drivers of tumor burden, which are the tumor growth rate and carrying capacity as well as the tumor kill rate by T cells, and the two modeled forms of immunosuppression, PD-L1-PD-1 immune checkpoint and MDSC suppression of T cells. Thus, treatment with an immune checkpoint inhibitor in combination with a therapeutic targeting the inhibitory mechanisms of MDSCs should be explored.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1186/s12967-023-04222-3
