skip to main content


Title: A checklist for maximizing reproducibility of ecological niche models
Abstract Reporting specific modelling methods and metadata is essential to the reproducibility of ecological studies, yet guidelines rarely exist regarding what information should be noted. Here, we address this issue for ecological niche modelling or species distribution modelling, a rapidly developing toolset in ecology used across many aspects of biodiversity science. Our quantitative review of the recent literature reveals a general lack of sufficient information to fully reproduce the work. Over two-thirds of the examined studies neglected to report the version or access date of the underlying data, and only half reported model parameters. To address this problem, we propose adopting a checklist to guide studies in reporting at least the minimum information necessary for ecological niche modelling reproducibility, offering a straightforward way to balance efficiency and accuracy. We encourage the ecological niche modelling community, as well as journal reviewers and editors, to utilize and further develop this framework to facilitate and improve the reproducibility of future work. The proposed checklist framework is generalizable to other areas of ecology, especially those utilizing biodiversity data, environmental data and statistical modelling, and could also be adopted by a broader array of disciplines.  more » « less
Award ID(s):
1661510
NSF-PAR ID:
10273085
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Nature Ecology & Evolution
Volume:
3
Issue:
10
ISSN:
2397-334X
Page Range / eLocation ID:
1382 to 1395
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Biodiversity studies rely heavily on estimates of species' distributions often obtained through ecological niche modelling. Numerous software packages exist that allow users to model ecological niches using machine learning and statistical methods. However, no existing package with a graphical user interface allows users to perform model calibration and selection based on convex forms such as ellipsoids, which may match fundamental ecological niche shapes better, incorporating tools for exploring, modelling, and evaluating niches and distributions that are intuitive for both novice and proficient users.

    Here we describe anrpackage, NicheToolBox(ntbox), that allows users to conduct all processing steps involved in ecological niche modelling: downloading and curating occurrence data, obtaining and transforming environmental data layers, selecting environmental variables, exploring relationships between geographic and environmental spaces, calibrating and selecting ellipsoid models, evaluating models using binomial and partial ROC tests, assessing extrapolation risk, and performing geographic information system operations via a graphical user interface. A summary of the entire workflow is produced for use as a stand‐alone algorithm or as part of research reports.

    The method is explained in detail and tested via modelling the threatened feline speciesLeopardus wiedii. Georeferenced occurrence data for this species are queried to display both point occurrences and the IUCN extent of occurrence polygon (IUCN, 2007). This information is used to illustrate tools available for accessing, processing and exploring biodiversity data (e.g. number of occurrences and chronology of collecting) and transforming environmental data (e.g. a summary PCA for 19 bioclimatic layers). Visualizations of three‐dimensional ecological niches modelled as minimum volume ellipsoids are developed with ancillary statistics. This niche model is then projected to geographic space, to represent a corresponding potential suitability map.

    Usingntboxallows a fast and straightforward means by which to retrieve and manipulate occurrence and environmental data, which can then be implemented in model calibration, projection and evaluation for assessing distributions of species in geographic space and their corresponding environmental combinations.

     
    more » « less
  2. The ubiquitous pollution of the environment with microplastics, a diverse suite of contaminants, is of growing concern for science and currently receives considerable public, political, and academic attention. The potential impact of microplastics in the environment has prompted a great deal of research in recent years. Many diverse methods have been developed to answer different questions about microplastic pollution, from sources, transport, and fate in the environment, and about effects on humans and wildlife. These methods are often insufficiently described, making studies neither comparable nor reproducible. The proliferation of new microplastic investigations and cross-study syntheses to answer larger scale questions are hampered. This diverse group of 23 researchers think these issues can begin to be overcome through the adoption of a set of reporting guidelines. This collaboration was created using an open science framework that we detail for future use. Here, we suggest harmonized reporting guidelines for microplastic studies in environmental and laboratory settings through all steps of a typical study, including best practices for reporting materials, quality assurance/quality control, data, field sampling, sample preparation, microplastic identification, microplastic categorization, microplastic quantification, and considerations for toxicology studies. We developed three easy to use documents, a detailed document, a checklist, and a mind map, that can be used to reference the reporting guidelines quickly. We intend that these reporting guidelines support the annotation, dissemination, interpretation, reviewing, and synthesis of microplastic research. Through open access licensing (CC BY 4.0), these documents aim to increase the validity, reproducibility, and comparability of studies in this field for the benefit of the global community. 
    more » « less
  3. Abstract

    Stage‐based demographic methods, such as matrix population models (MPMs), are powerful tools used to address a broad range of fundamental questions in ecology, evolutionary biology and conservation science. Accordingly, MPMs now exist for over 3000 species worldwide. These data are being digitised as an ongoing process and periodically released into two large open‐access online repositories: the COMPADRE Plant Matrix Database and the COMADRE Animal Matrix Database. During the last decade, data archiving and curation of COMPADRE and COMADRE, and subsequent comparative research, have revealed pronounced variation in how MPMs are parameterized and reported.

    Here, we summarise current issues related to the parameterisation and reporting of MPMs that arise most frequently and outline how they affect MPM construction, analysis, and interpretation. To quantify variation in how MPMs are reported, we present results from a survey identifying key aspects of MPMs that are frequently unreported in manuscripts. We then screen COMPADRE and COMADRE to quantify how often key pieces of information are omitted from manuscripts using MPMs.

    Over 80% of surveyed researchers (n = 60) state a clear benefit to adopting more standardised methodologies for reporting MPMs. Furthermore, over 85% of the 300 MPMs assessed from COMPADRE and COMADRE omitted one or more elements that are key to their accurate interpretation. Based on these insights, we identify fundamental issues that can arise from MPM construction and communication and provide suggestions to improve clarity, reproducibility and future research utilising MPMs and their required metadata. To fortify reproducibility and empower researchers to take full advantage of their demographic data, we introduce a standardised protocol to present MPMs in publications. This standard is linked towww.compadre‐db.org, so that authors wishing to archive their MPMs can do so prior to submission of publications, following examples from other open‐access repositories such as DRYAD, Figshare and Zenodo.

    Combining and standardising MPMs parameterized from populations around the globe and across the tree of life opens up powerful research opportunities in evolutionary biology, ecology and conservation research. However, this potential can only be fully realised by adopting standardised methods to ensure reproducibility.

     
    more » « less
  4. Abstract

    Data deficiencies among rare or cryptic species preclude assessment of community‐level processes using many existing approaches, limiting our understanding of the trends and stressors for large numbers of species. Yet evaluating the dynamics of whole communities, not just common or charismatic species, is critical to understanding and the responses of biodiversity to ongoing environmental pressures.

    A recent surge in both public science and government‐funded data collection efforts has led to a wealth of biodiversity data. However, these data collection programmes use a wide range of sampling protocols (from unstructured, opportunistic observations of wildlife to well‐structured, design‐based programmes) and record information at a variety of spatiotemporal scales. As a result, available biodiversity data vary substantially in quantity and information content, which must be carefully reconciled for meaningful ecological analysis.

    Hierarchical modelling, including single‐species integrated models and hierarchical community models, has improved our ability to assess and predict biodiversity trends and processes. Here, we highlight the emerging ‘integrated community modelling’ framework that combines both data integration and community modelling to improve inferences on species‐ and community‐level dynamics.

    We illustrate the framework with a series of worked examples. Our three case studies demonstrate how integrated community models can be used to extend the geographic scope when evaluating species distributions and community‐level richness patterns; discern population and community trends over time; and estimate demographic rates and population growth for communities of sympatric species. We implemented these worked examples using multiple software methods through the R platform via packages with formula‐based interfaces and through development of custom code in JAGS, NIMBLE and Stan.

    Integrated community models provide an exciting approach to model biological and observational processes for multiple species using multiple data types and sources simultaneously, thus accounting for uncertainty and sampling error within a unified framework. By leveraging the combined benefits of both data integration and community modelling, integrated community models can produce valuable information about both common and rare species as well as community‐level dynamics, allowing for holistic evaluation of the effects of global change on biodiversity.

     
    more » « less
  5. Abstract

    A major goal of community ecology is understanding the processes responsible for generating biodiversity patterns along spatial and environmental gradients. In stream ecosystems, system‐specific conceptual frameworks have dominated research describing biodiversity change along longitudinal gradients of river networks. However, support for these conceptual frameworks has been mixed, mainly applicable to specific stream ecosystems and biomes, and these frameworks have placed less emphasis on general mechanisms driving biodiversity patterns. Rethinking biodiversity patterns and processes in stream ecosystems with a focus on the overarching mechanisms common across ecosystems will provide a more holistic understanding of why biodiversity patterns vary along river networks. In this study, we apply the theory of ecological communities (TEC) conceptual framework to stream ecosystems to focus explicitly on the core ecological processes structuring communities: dispersal, speciation, niche selection, and ecological drift. Using a unique case study from high‐elevation networks of connected lakes and streams, we sampled stream invertebrate communities in the Sierra Nevada, California, USA to test established stream ecology frameworks and compared them with the TEC framework. Local diversity increased and β‐diversity decreased moving downstream from the headwaters, consistent with the river continuum concept and the small but mighty framework of mountain stream biodiversity. Local diversity was also structured by distance below upstream lakes, where diversity increased with distance below upstream lakes, in support of the serial discontinuity concept. Despite some support for the biodiversity patterns predicted from the stream ecology frameworks, no single framework was fully supported, suggesting “context dependence.” By framing our results under the TEC, we found that species diversity was structured by niche selection, where local diversity was highest in environmentally favorable sites. Local diversity was also highest in sites with small community sizes, countering the predicted effects of ecological drift. Moreover, higher β‐diversity in the headwaters was influenced by dispersal and niche selection, where environmentally harsh and spatially isolated sites exhibit higher community variation. Taken together our results suggest that combining system‐specific ecological frameworks with the TEC provides a powerful approach for inferring the mechanisms driving biodiversity patterns and provides a path toward generalization of biodiversity research across ecosystems.

     
    more » « less