skip to main content


Title: Embedding communication concepts in forecasting training increases students' understanding of ecological uncertainty
Abstract

Communicating and interpreting uncertainty in ecological model predictions is notoriously challenging, motivating the need for new educational tools, which introduce ecology students to core concepts in uncertainty communication. Ecological forecasting, an emerging approach to estimate future states of ecological systems with uncertainty, provides a relevant and engaging framework for introducing uncertainty communication to undergraduate students, as forecasts can be used as decision support tools for addressing real‐world ecological problems and are inherently uncertain. To provide critical training on uncertainty communication and introduce undergraduate students to the use of ecological forecasts for guiding decision‐making, we developed a hands‐on teaching module within the Macrosystems Environmental Data‐Driven Inquiry and Exploration (EDDIE;MacrosystemsEDDIE.org) educational program. Our module used an active learning approach by embedding forecasting activities in an R Shiny application to engage ecology students in introductory data science, ecological modeling, and forecasting concepts without needing advanced computational or programming skills. Pre‐ and post‐module assessment data from more than 250 undergraduate students enrolled in ecology, freshwater ecology, and zoology courses indicate that the module significantly increased students' ability to interpret forecast visualizations with uncertainty, identify different ways to communicate forecast uncertainty for diverse users, and correctly define ecological forecasting terms. Specifically, students were more likely to describe visual, numeric, and probabilistic methods of uncertainty communication following module completion. Students were also able to identify more benefits of ecological forecasting following module completion, with the key benefits of using forecasts for prediction and decision‐making most commonly described. These results show promise for introducing ecological model uncertainty, data visualizations, and forecasting into undergraduate ecology curricula via software‐based learning, which can increase students' ability to engage and understand complex ecological concepts.

 
more » « less
Award ID(s):
1926050 1933016 1926388 1933102
NSF-PAR ID:
10442186
Author(s) / Creator(s):
 ;  ;  ;  ;  
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Ecosphere
Volume:
14
Issue:
8
ISSN:
2150-8925
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Ecological forecasting is an emerging approach to estimate the future state of an ecological system with uncertainty, allowing society to better manage ecosystem services. Ecological forecasting is a core mission of the U.S. National Ecological Observatory Network (NEON) and several federal agencies, yet, to date, forecasting training has focused on graduate students, representing a gap in undergraduate ecology curricula. In response, we developed a teaching module for the Macrosystems EDDIE (Environmental Data-Driven Inquiry and Exploration; MacrosystemsEDDIE.org) educational program to introduce ecological forecasting to undergraduate students through an interactive online tool built with R Shiny. To date, we have assessed this module, “Introduction to Ecological Forecasting,” at ten universities and two conference workshops with both undergraduate and graduate students (N = 136 total) and found that the module significantly increased undergraduate students’ ability to correctly define ecological forecasting terms and identify steps in the ecological forecasting cycle. Undergraduate and graduate students who completed the module showed increased familiarity with ecological forecasts and forecast uncertainty. These results suggest that integrating ecological forecasting into undergraduate ecology curricula will enhance students’ abilities to engage and understand complex ecological concepts. 
    more » « less
  2. Because of increased variability in populations, communities, and ecosystems due to land use and climate change, there is a pressing need to know the future state of ecological systems across space and time. Ecological forecasting is an emerging approach which provides an estimate of the future state of an ecological system with uncertainty, allowing society to preemptively prepare for fluctuations in important ecosystem services. However, forecasts must be effectively designed and communicated to those who need them to make decisions in order to realize their potential for protecting natural resources. In this module, students will explore real ecological forecast visualizations, identify ways to represent uncertainty, make management decisions using forecast visualizations, and learn decision support techniques. Lastly, students customize a forecast visualization for a specific stakeholder's decision needs. The overarching goal of this module is for students to understand how forecasts are connected to decision-making of stakeholders, or the managers, policy-makers, and other members of society who use forecasts to inform decision-making. The A-B-C structure of this module makes it flexible and adaptable to a range of student levels and course structures. This EDI data package contains instructional materials and the files necessary to teach the module. Readers are referred to the Zenodo data package (Woelmer et al. 2022; DOI: 10.5281/zenodo.7074674) for the R Shiny application code needed to run the module locally. 
    more » « less
  3. This EDI data package contains instructional materials necessary to teach Macrosystems EDDIE Module 6: Understanding Uncertainty in Ecological Forecasts, a ~3-hour educational module for undergraduates. Ecological forecasting is an emerging approach that provides an estimate of the future state of an ecological system with uncertainty, allowing society to prepare for changes in important ecosystem services. Forecast uncertainty is derived from multiple sources, including model parameters and driver data, among others. Knowing the uncertainty associated with a forecast enables forecast users to evaluate the forecast and make more informed decisions. This module will guide students through an exploration of the sources of uncertainty within an ecological forecast, how uncertainty can be quantified, and steps that can be taken to reduce the uncertainty in a forecast that students develop for a lake ecosystem, using data from the National Ecological Observatory Network (NEON). Students will visualize data, build a model, generate a forecast with uncertainty, and then compare the contributions of various sources of forecast uncertainty to total forecast uncertainty. The flexible, three-part (A-B-C) structure of this module makes it adaptable to a range of student levels and course structures. There are two versions of the module: an R Shiny application which does not require students to code, and an RMarkdown version which requires students to read and alter R code to complete module activities. The R Shiny application is published to shinyapps.io and is available at the following link: https://macrosystemseddie.shinyapps.io/module6/. GitHub repositories are available for both the R Shiny (https://github.com/MacrosystemsEDDIE/module6) and RMarkdown versions (https://github.com/MacrosystemsEDDIE/module6_R) of the module, and both code repositories have been published with DOIs to Zenodo (R Shiny version at https://zenodo.org/doi/10.5281/zenodo.10380759 and RMarkdown version at https://zenodo.org/doi/10.5281/zenodo.10380339). Readers are referred to the module landing page for additional information (https://serc.carleton.edu/eddie/teaching_materials/modules/module6.html). 
    more » « less
  4. Abstract

    Probabilistic near‐term forecasting facilitates evaluation of model predictions against observations and is of pressing need in ecology to inform environmental decision‐making and effect societal change. Despite this imperative, many ecologists are unfamiliar with the widely used tools for evaluating probabilistic forecasts developed in other fields. We address this gap by reviewing the literature on probabilistic forecast evaluation from diverse fields including climatology, economics, and epidemiology. We present established practices for selecting evaluation data (end‐sample hold out), graphical forecast evaluation (times‐series plots with uncertainty, probability integral transform plots), quantitative evaluation using scoring rules (log, quadratic, spherical, and ranked probability scores), and comparing scores across models (skill score, Diebold–Mariano test). We cover common approaches, highlight mathematical concepts to follow, and note decision points to allow application of general principles to specific forecasting endeavors. We illustrate these approaches with an application to a long‐term rodent population time series currently used for ecological forecasting and discuss how ecology can continue to learn from and drive the cross‐disciplinary field of forecasting science.

     
    more » « less
  5. Ecologists are increasingly using macrosystems approaches to understand population, community, and ecosystem dynamics across interconnected spatial and temporal scales. Consequently, integrating macrosystems skills, including simulation modeling and sensor data analysis, into undergraduate and graduate curricula is needed to train future environmental biologists. Through the Macrosystems EDDIE (Environmental Data-Driven Inquiry and Exploration) program, we developed four teaching modules to introduce macrosystems ecology to ecology and biology students. Modules combine high-frequency sensor data from GLEON (Global Lake Ecological Observatory Network) and NEON (National Ecological Observatory Network) sites with ecosystem simulation models. Pre- and post-module assessments of 319 students across 24 classrooms indicate that hands-on, inquiry-based modules increase students’ understanding of macrosystems ecology, including complex processes that occur across multiple spatial and temporal scales. Following module use, students were more likely to correctly define macrosystems concepts, interpret complex data visualizations and apply macrosystems approaches in new contexts. In addition, there was an increase in student’s self-perceived proficiency and confidence using both long-term and high-frequency data; key macrosystems ecology techniques. Our results suggest that integrating short (1–3 h) macrosystems activities into ecology courses can improve students’ ability to interpret complex and non-linear ecological processes. In addition, our study serves as one of the first documented instances for directly incorporating concepts in macrosystems ecology into undergraduate and graduate ecology and biology curricula. 
    more » « less