Title: Statistical Applications to Cognitive Diagnostic Testing
Diagnostic classification tests are designed to assess examinees’ discrete mastery status on a set of skills or attributes. Such tests have gained increasing attention in educational and psychological measurement. We review diagnostic classification models and their applications to testing and learning, discuss their statistical and machine learning connections and related challenges, and introduce some contemporary and future extensions. more »« less
Zhang, Susu; Liu, Jingchen; Ying, Zhiliang
(, Annual review of statistics and its application)
Reid, Nancy
(Ed.)
Diagnostic classification tests are designed to assess examinees’ discrete mastery status on a set of skills or attributes. Such tests have gained increas- ing attention in educational and psychological measurement. We review diagnostic classification models and their applications to testing and learning, discuss their statistical and machine learning connections and related challenges, and introduce some contemporary and future extensions.
Neurological disorders generally involve multiple kinds of changes in the functional and structural properties of the brain. In this study, we develop a CNN-based multimodal deep learning pipeline by exploiting both functional and structural neuroimaging features to generate full-brain maps that encode significant differences between patient groups and between modalities in terms of their distinctive contribution towards diagnostic classification of Alzheimer’s disease. Through a repeated cross-validation procedure and robust statistical analysis, we show that our approach can be used to encode highly discriminative and abstract information from full-brain data, while also retaining the ability to identify and categorize significantly contributing voxel-level features based on their salient strength in various diagnostic and modality-related contexts. Our results on an Alzheimer’s disease classification task show that such approaches can be used for creating more elaborately defined biomarkers for brain disorders.
Standring, S.; Forero, D.; Weirauch, C.
(, Systematic Entomology)
Abstract Web‐building spiders are formidable predators, yet assassin bugs in the Emesine Complex (Hemiptera: Reduviidae: Emesinae, Saicinae, and Visayanocorinae) prey on spiders. The Emesine Complex comprises >1000 species and these web‐associated predatory strategies may have driven their diversification. However, lack of natural history data and a robust phylogenetic framework currently preclude tests of this hypothesis. We combine Sanger (207 taxa, 3865 bp) and high‐throughput sequencing data (15 taxa, 381 loci) to generate the first taxon‐ and data‐rich phylogeny for this group. We discover rampant paraphyly among subfamilies and tribes, necessitating revisions to the classification. We use ancestral character state reconstructions for 40 morphological characters to identify diagnostic features for a revised classification. Our new classification treats Saicinae Stål and Visayanocorinae Miller as junior synonyms of Emesinae Amyot and Serville, synonymizes the emesine tribes Ploiariolini Van Duzee and Metapterini Stål with Emesini Amyot and Serville, and recognises six tribes within Emesinae (Collartidini Wygodzinsky, Emesini, Leistarchini Stål, Oncerotrachelinitrib.n., Saicini Stålstat.n., and Visayanocorini Millerstat.n.). We show that a pretarsal structure putatively involved in web‐associated behaviours evolved in the last common ancestor of Emesini, the most species‐rich clade within Emesinae, suggesting that web‐associations could be widespread in Emesinae.
Oswald, Willaim; Browning, Craig; Yasmin, Ruthba; Deal, Joshua; Rich, Thomas C; Leavesley, Silas J; Gong, Na
(, Scientific Reports)
Abstract Colorectal cancer is one of the top contributors to cancer-related deaths in the United States, with over 100,000 estimated cases in 2020 and over 50,000 deaths. The most common screening technique is minimally invasive colonoscopy using either reflected white light endoscopy or narrow-band imaging. However, current imaging modalities have only moderate sensitivity and specificity for lesion detection. We have developed a novel fluorescence excitation-scanning hyperspectral imaging (HSI) approach to sample image and spectroscopic data simultaneously on microscope and endoscope platforms for enhanced diagnostic potential. Unfortunately, fluorescence excitation-scanning HSI datasets pose major challenges for data processing, interpretability, and classification due to their high dimensionality. Here, we present an end-to-end scalable Artificial Intelligence (AI) framework built for classification of excitation-scanning HSI microscopy data that provides accurate image classification and interpretability of the AI decision-making process. The developed AI framework is able to perform real-time HSI classification with different speed/classification performance trade-offs by tailoring the dimensionality of the dataset, supporting different dimensions of deep learning models, and varying the architecture of deep learning models. We have also incorporated tools to visualize the exact location of the lesion detected by the AI decision-making process and to provide heatmap-based pixel-by-pixel interpretability. In addition, our deep learning framework provides wavelength-dependent impact as a heatmap, which allows visualization of the contributions of HSI wavelength bands during the AI decision-making process. This framework is well-suited for HSI microscope and endoscope platforms, where real-time analysis and visualization of classification results are required by clinicians.
Lu, Hao; Allen, Cade; Nemani, Venkat; Hu, Chao; Zimmerman, Andrew
(, Proceedings of the 2022 International Symposium on Flexible Automation)
Early fault detection in rolling element bearings is pivotal for the effective predictive maintenance of rotating machinery. Deep Learning (DL) methods have been widely studied for vibration-based bearing fault diagnostics largely because of their capability to automatically extract fault-related features from raw or processed vibration data. Although most DL models in the current literature can provide fairly accurate classification outputs, the typical diagnostic procedure is performed in an offline environment utilizing powerful computers. This centralized approach can lead to unacceptable delays in safety-critical applications and can prohibit cost-sensitive wireless data collection. Meanwhile, very few studies have reported on deploying DL models on microprocessor-based Industrial Internet of Things (IIoT) devices, where edge computing can give users a real-time evaluation of bearing health without requiring expensive computational infrastructure. This paper demonstrates an IIoT deployment of a physics-informed DL model inside a commercially available wireless vibration sensor for online health classification. The diagnostic model here is developed and trained offline, and the trained model is then deployed inside the embedded system for online prediction. We demonstrate the model’s online diagnostic performance by imitating bearing vibration signals on a vibration shaker and by performing edge computing on the embedded system mounted on the shaker.
Zhang, Susu, Liu, Jingchen, and Ying, Zhiliang. Statistical Applications to Cognitive Diagnostic Testing. Retrieved from https://par.nsf.gov/biblio/10484753. Annual Review of Statistics and Its Application 10.1 Web. doi:10.1146/annurev-statistics-033021-111803.
@article{osti_10484753,
place = {Country unknown/Code not available},
title = {Statistical Applications to Cognitive Diagnostic Testing},
url = {https://par.nsf.gov/biblio/10484753},
DOI = {10.1146/annurev-statistics-033021-111803},
abstractNote = {Diagnostic classification tests are designed to assess examinees’ discrete mastery status on a set of skills or attributes. Such tests have gained increasing attention in educational and psychological measurement. We review diagnostic classification models and their applications to testing and learning, discuss their statistical and machine learning connections and related challenges, and introduce some contemporary and future extensions.},
journal = {Annual Review of Statistics and Its Application},
volume = {10},
number = {1},
publisher = {Annual Review of Statistics and Its Application},
author = {Zhang, Susu and Liu, Jingchen and Ying, Zhiliang},
}
Warning: Leaving National Science Foundation Website
You are now leaving the National Science Foundation website to go to a non-government website.
Website:
NSF takes no responsibility for and exercises no control over the views expressed or the accuracy of
the information contained on this site. Also be aware that NSF's privacy policy does not apply to this site.