Stereology-based methods provide the current state-of-the-art approaches for accurate quantification of numbers and other morphometric parameters of biological objects in stained tissue sections. The advent of artificial intelligence (AI)-based deep learning (DL) offers the possibility of improving throughput by automating the collection of stereology data. We have recently shown that DL can effectively achieve comparable accuracy to manual stereology but with higher repeatability, improved throughput, and less variation due to human factors by quantifying the total number of immunostained cells at their maximal profile of focus in extended depth of field (EDF) images. In the first of two novel contributions in this work, we propose a semi-automatic approach using a handcrafted Adaptive Segmentation Algorithm (ASA) to automatically generate ground truth on EDF images for training our deep learning (DL) models to automatically count cells using unbiased stereology methods. This update increases the amount of training data, thereby improving the accuracy and efficiency of automatic cell counting methods, without a requirement for extra expert time. The second contribution of this work is a Multi-channel Input and Multi-channel Output (MIMO) method using a U-Net deep learning architecture for automatic cell counting in a stack of z-axis images (also known as disector stacks). This DL-based digital automation of the ordinary optical fractionator ensures accurate counts through spatial separation of stained cells in the z-plane, thereby avoiding false negatives from overlapping cells in EDF images without the shortcomings of 3D and recurrent DL models. The contribution overcomes the issue of under-counting errors with EDF images due to overlapping cells in the z-plane (masking). We demonstrate the practical applications of these advances with automatic disector-based estimates of the total number of NeuN-immunostained neurons in a mouse neocortex. In summary, this work provides the first demonstration of automatic estimation of a total cell number in tissue sections using a combination of deep learning and the disector-based optical fractionator method.
more »
« less
NOVEL STAIN SEPARATION METHOD FOR AUTOMATIC STEREOLOGY OF IMMUNOSTAINED TISSUE SECTIONS
Abstract Many studies of brain aging and neurodegenerative disorders such as Alzheimer’s and Parkinson’s diseases require rapid counts of high signal: noise (S:N) stained brain cells such as neurons and neuroglial (microglia cells) on tissue sections. To increase throughput efficiency of this work, we have combined deep learned (DL) neural networks and computerized stereology (DL-stereology) for automatic cell counts with low error (<10%) compared to time-intensive manual counts. To date, however, this approach has been limited to sections with a single high S:N immunostain for neurons (NeuN) or microglial cells (Iba-1). The present study expands this approach to protocols that combine immunostains with counterstains, e.g., cresyl violet (CV). In our method, a stain separation technique called Sparse Non-negative Matrix Factorization (SNMF) converts a dual-stained color image to a single gray image showing only the principal immunostain. Validation testing was done using semi- and automatic stereology-based counts of sections immunostained for neurons or microglia with CV counterstaining from the neocortex of a transgenic mouse model of tauopathy (Tg4510 mouse) and controls. Cell count results with principal stain gray images show an average error rate of 16.78% and 28.47% for the semi-automatic approach and 8.51% and 9.36% for the fully-automatic DL-stereology approach for neurons and microglia, respectively, as compared to manual cell counts (ground truth). This work indicates that stain separation by SNMF can support high throughput, fully automatic DL-stereology based counts of neurons and microglia on counterstained tissue sections.
more »
« less
- Award ID(s):
- 1926990
- NSF-PAR ID:
- 10143179
- Date Published:
- Journal Name:
- Innovation in Aging
- Volume:
- 3
- Issue:
- Supplement_1
- ISSN:
- 2399-5300
- Page Range / eLocation ID:
- S256 to S256
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Across basic research studies, cell counting requires significant human time and expertise. Trained experts use thin focal plane scanning to count (click) cells in stained biological tissue. This computer-assisted process (optical disector) requires a well-trained human to select a unique best z-plane of focus for counting cells of interest. Though accurate, this approach typically requires an hour per case and is prone to inter-and intra-rater errors. Our group has previously proposed deep learning (DL)-based methods to automate these counts using cell segmentation at high magnification. Here we propose a novel You Only Look Once (YOLO) model that performs cell detection on multi-channel z-plane images (disector stack). This automated Multiple Input Multiple Output (MIMO) version of the optical disector method uses an entire z-stack of microscopy images as its input, and outputs cell detections (counts) with a bounding box of each cell and class corresponding to the z-plane where the cell appears in best focus. Compared to the previous segmentation methods, the proposed method does not require time-and labor-intensive ground truth segmentation masks for training, while producing comparable accuracy to current segmentation-based automatic counts. The MIMO-YOLO method was evaluated on systematic-random samples of NeuN-stained tissue sections through the neocortex of mouse brains (n=7). Using a cross validation scheme, this method showed the ability to correctly count total neuron numbers with accuracy close to human experts and with 100% repeatability (Test-Retest).more » « less
-
Training deep learning models for unbiased stereology requires a large data set with associated ground truth. However manual ground truth annotation is tedious, time-consuming, and expert dependent. We propose an active deep learning method for automatic stereology counts using a snapshot ensemble approach. The method provides a confidence score for each mask in an unlabeled pool that reduces user verification to only images with high information content for training the deep learning model. The proposed method reduces the error rate to less than 1% for unbiased stereology cell counts on immunostained brain cells compared to manual stereology and requires ~25% less expert verification time compared to a previously proposed iterative deep learning approach.more » « less
-
INTRODUCTION The analysis of the human brain is a central goal of neuroscience, but for methodological reasons, research has focused on model organisms, the mouse in particular. Because substantial homology was found at the level of ion channels, transcriptional programs, and basic neuronal types, a strong similarity of neuronal circuits across species has also been assumed. However, a rigorous test of the configuration of local neuronal circuitry in mouse versus human—in particular, in the gray matter of the cerebral cortex—is missing. The about 1000-fold increase in number of neurons is the most obvious evolutionary change of neuronal network properties from mouse to human. Whether the structure of the local cortical circuitry has changed as well is, however, unclear. Recent data from transcriptomic analyses has indicated an increase in the proportion of inhibitory interneurons from mouse to human. But what the effect of such a change is on the circuit configurations found in the human cerebral cortex is not known. This is, however, of particular interest also to the study of neuropsychiatric disorders because in these, the alteration of inhibitory-to-excitatory synaptic balance has been identified as one possible mechanistic underpinning. RATIONALE We used recent methodological improvements in connectomics to acquire data from one macaque and two human individuals, using biopsies of the temporal, parietal, and frontal cortex. Human tissue was obtained from neurosurgical interventions related to tumor removal, in which access path tissue was harvested that was not primarily affected by the underlying disease. A key concern in the analysis of human patient tissue has been the relation to epilepsy surgery, when the underlying disease has required often year-long treatment with pharmaceuticals, plausibly altering synaptic connectivity. Therefore, the analysis of nonepileptic surgery tissue seemed of particular importance. We also included data from one macaque individual, who was not known to have any brain-related pathology. RESULTS We acquired three-dimensional electron microscopy data from temporal and frontal cortex of human and temporal and parietal cortex of macaque. From these, we obtained connectomic reconstructions and compared these with five connectomes from mouse cortex. On the basis of these data, we were able to determine the effect of the about 2.5-fold expansion of the interneuron pool in macaque and human cortex compared with that of mouse. Contrary to expectation, the inhibitory-to-excitatory synaptic balance on pyramidal neurons in macaque and human cortex was not substantially altered. Rather, the interneuron pool was selectively expanded for bipolar-type interneurons, which prefer the innervation of other interneurons, and which further increased their preference for interneuron innervation from mouse to human. These changes were each multifold, yielding in effect an about 10-fold expanded interneuron-to-interneuron network in the human cortex that is only sparsely present in mouse. The total amount of synaptic input to pyramidal neurons, however, did not change according to the threefold thickening of the cortex; rather, a modest increase from about 12,000 synaptic inputs in mouse to about 15,000 in human was found. CONCLUSION The principal cells of the cerebral cortex, pyramidal neurons, maintain almost constant inhibitory-to-excitatory input balance and total synaptic input across 100 million years of evolutionary divergence, which is particularly noteworthy with the concomitant 1000-fold expansion of the neuronal network size and the 2.5-fold increase of inhibitory interneurons from mouse to human. Rather, the key network change from mouse to human is an expansion of almost an order of magnitude of an interneuron-to-interneuron network that is virtually absent in mouse but constitutes a substantial part of the human cortical network. Whether this new network is primarily created through the expansion of existing neuronal types, or is related to the creation of new interneuron subtypes, requires further study. The discovery of this network component in human cortex encourages detailed analysis of its function in health and disease. Connectomic screening across mammalian species: Comparison of five mouse, two macaque, and two human connectomic datasets from the cerebral cortex. ( A ) Automated reconstructions of all neurons with their cell bodies in the volume shown, using random colors. The analyzed connectomes comprised a total of ~1.6 million synapses. Arrows indicate evolutionary divergence: the last common ancestor between human and mouse, approximately 100 million years ago, and the last common ancestor between human and macaque, about 20 million years ago. ( B ) Illustration of the about 10-fold expansion of the interneuron-to-interneuron network from mouse to human.more » « less
-
Tomaszewski, John E. ; Ward, Aaron D. (Ed.)Automatic cell quantification in microscopy images can accelerate biomedical research. There has been significant progress in the 3D segmentation of neurons in fluorescence microscopy. However, it remains a challenge in bright-field microscopy due to the low Signal-to-Noise Ratio and signals from out-of-focus neurons. Automatic neuron counting in bright-field z-stacks is often performed on Extended Depth of Field images or on only one thick focal plane image. However, resolving overlapping cells that are located at different z-depths is a challenge. The overlap can be resolved by counting every neuron in its best focus z-plane because of their separation on the z-axis. Unbiased stereology is the state-of-the-art for total cell number estimation. The segmentation boundary for cells is required in order to incorporate the unbiased counting rule for stereology application. Hence, we perform counting via segmentation. We propose to achieve neuron segmentation in the optimal focal plane by posing the binary segmentation task as a multi-class multi-label task. Also, we propose to efficiently use a 2D U-Net for inter-image feature learning in a Multiple Input Multiple Output system that poses a binary segmentation task as a multi-class multi-label segmentation task. We demonstrate the accuracy and efficiency of the MIMO approach using a bright-field microscopy z-stack dataset locally prepared by an expert. The proposed MIMO approach is also validated on a dataset from the Cell Tracking Challenge achieving comparable results to a compared method equipped with memory units. Our z-stack dataset is available atmore » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1093/geroni/igz038.958
