skip to main content

Title: How Widely Can Prediction Models Be Generalized? Performance Prediction in Blended Courses
Authors:
; ; ; ;
Award ID(s):
1821475
Publication Date:
NSF-PAR ID:
10119194
Journal Name:
IEEE Transactions on Learning Technologies
Volume:
12
Issue:
2
Page Range or eLocation-ID:
184 to 197
ISSN:
2372-0050
Sponsoring Org:
National Science Foundation
More Like this
  1. Risk prediction models are crucial for assessing the pretest probability of cancer and are applied to stratify patient management strategies. These models are frequently based on multivariate regression analysis, requiring that all risk factors be specified, and do not convey the confidence in their predictions. We present a framework for uncertainty analysis that accounts for variability in input values. Uncertain or missing values are replaced with a range of plausible values. These ranges are used to compute individualized risk confidence intervals. We demonstrate our approach using the Gail model to evaluate the impact of uncertainty on management decisions. Up to 13% of cases (uncertain) had a risk interval that falls within the decision threshold (e.g., 1.67% 5-year absolute risk). A small number of cases changed from low- to high-risk when missing values were present. Our analysis underscores the need for better communication of input assumptions that influence the resulting predictions.
  2. Abstract

    This study targeted improving Collaborative Adaptive Sensing of the Atmosphere’s (CASA) 6-h lead time predictive ability by blending the radar-based nowcast with the NWP model over the Dallas–Fort Worth (DFW) urban radar network. This study also depicts the recent updates in CASA’s real-time reflectivity nowcast system by assessing nine precipitation cases over the DFW urban region. CASA’s nowcast framework displayed better primer outcomes than the WRF Model forecast for the lead time of 1 h and 30 min. After that time, the predictive ability of the nowcast framework began decreasing compared to the WRF Model. To broaden CASA’s predictive system lead time to 6 h, the WRF Model forecasts were blended with Dynamic and Adaptive Radar Tracking of Storms (DARTS) nowcast. The HRRR model analysis was used as initial and boundary conditions in the WRF Model. The high-resolution dual-pol radar observations were assimilated into the WRF Model through the 3DVAR data assimilation technique. Three kinds of blending strategies were used and the results were compared: 1) hyperbolic tangent curve (HTW), 2) critical success index (CSIW), and 3) salient cross dissolve (Sal CD). The sensitivity studies were conducted to decide desirable parameters in the blending techniques. The outcomes proved thatmore »blending enhanced the prediction skills. Also, the overall performance of blending relies on the accuracy of the WRF forecast. Even though blending results are mixed, the HTW-based technique performed better than the other two techniques.

    « less