skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: How to Improve the Reproducibility, Replicability, and Extensibility of Remote Sensing Research
The field of remote sensing has undergone a remarkable shift where vast amounts of imagery are now readily available to researchers. New technologies, such as uncrewed aircraft systems, make it possible for anyone with a moderate budget to gather their own remotely sensed data, and methodological innovations have added flexibility for processing and analyzing data. These changes create both the opportunity and need to reproduce, replicate, and compare remote sensing methods and results across spatial contexts, measurement systems, and computational infrastructures. Reproducing and replicating research is key to understanding the credibility of studies and extending recent advances into new discoveries. However, reproducibility and replicability (R&R) remain issues in remote sensing because many studies cannot be independently recreated and validated. Enhancing the R&R of remote sensing research will require significant time and effort by the research community. However, making remote sensing research reproducible and replicable does not need to be a burden. In this paper, we discuss R&R in the context of remote sensing and link the recent changes in the field to key barriers hindering R&R while discussing how researchers can overcome those barriers. We argue for the development of two research streams in the field: (1) the coordinated execution of organized sequences of forward-looking replications, and (2) the introduction of benchmark datasets that can be used to test the replicability of results and methods.  more » « less
Award ID(s):
2225079 2049837
PAR ID:
10386084
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Remote Sensing
Volume:
14
Issue:
21
ISSN:
2072-4292
Page Range / eLocation ID:
5471
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Remote Sensing)
    Many issues can reduce the reproducibility and replicability of deep learning (DL) research and application in remote sensing, including the complexity and customizability of architectures, variable model training and assessment processes and practice, inability to fully control random components of the modeling workflow, data leakage, computational demands, and the inherent nature of the process, which is complex, difficult to perform systematically, and challenging to fully document. This communication discusses key issues associated with convolutional neural network (CNN)-based DL in remote sensing for undertaking semantic segmentation, object detection, and instance segmentation tasks and offers suggestions for best practices for enhancing reproducibility and replicability and the subsequent utility of research results, proposed workflows, and generated data. We also highlight lingering issues and challenges facing researchers as they attempt to improve the reproducibility and replicability of their experiments. 
    more » « less
  2. ; ; ; ; ; ; (, Cartography and Geographic Information Science)
    The reproducibility and replicability (R&R) crisis poses a significant challenge across disciplines, particularly in spatiotemporal studies. This paper focuses on the unique challenges within spatiotemporal research in the context of R&R, including data availability, methodological conception transparency, interdisciplinary collaboration complexities, the balance between R&R and innovation, and R&R education. Recognizing the potential of Scientific Workflow Management Systems (SWMS) to enhance R&R, we introduce a pioneering SWMS-based integrated spatiotemporal research approach (SISRA) utilizing KNIME, an open-source SWMS, to tackle these R&R challenges. First, we developed a set of KNIME extensions, including Geospatial and Dataverse extensions, to enhance spatiotemporal software availability in SWMS. Then we created spatial data virtual laboratory architecture to support multidisciplinary collaboration. Finally, we suggested a geographical research lifecycle that integrates SWMS-based methods to improve practices, efficiency, and innovation in R&R research and education. Our approach exemplifies how executable workflows can not only alleviate the R&R burden on researchers but also strengthen R&R education in geographical research, illustrating the benefits of our approach in training, teaching, and multidisciplinary collaboration. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, Frontiers in Marine Science)
    Surface-canopy forming kelps provide the foundation for ecosystems that are ecologically, culturally, and economically important. However, these kelp forests are naturally dynamic systems that are also threatened by a range of global and local pressures. As a result, there is a need for tools that enable managers to reliably track changes in their distribution, abundance, and health in a timely manner. Remote sensing data availability has increased dramatically in recent years and this data represents a valuable tool for monitoring surface-canopy forming kelps. However, the choice of remote sensing data and analytic approach must be properly matched to management objectives and tailored to the physical and biological characteristics of the region of interest. This review identifies remote sensing datasets and analyses best suited to address different management needs and environmental settings using case studies from the west coast of North America. We highlight the importance of integrating different datasets and approaches to facilitate comparisons across regions and promote coordination of management strategies. 
    more » « less
  4. ; ; ; ; (, Ecosphere)
    Abstract Many recent studies have explored remote sensing approaches to facilitate non‐destructive sampling of aboveground biomass (AGB). Lidar platforms (e.g., iPhone and iPad PRO models) have recently made remote sensing technologies widely available and present an alternative to traditional approaches for estimating AGB. Lidar approaches can be completed within a fraction of the time required by many analog methods. However, it is unknown if handheld sensors are capable of accurately predicting AGB or how different modeling techniques affect prediction accuracy. Here, we collected AGB from 0.25‐m2plots (N = 45) from three sites along an elevational gradient within rangelands surrounding Flagstaff, Arizona, USA. Each plot was scanned with a mobile laser scanner (MLS) and iPad before plants were clipped, dried, and weighed. We compared the capability of iPad and MLS sensors to estimate AGB via minimization of model normalized root mean square error (NRMSE). This process was performed on predictor subsets describing structural, spectral, and field‐based characteristics across a suite of modeling approaches including simple linear, stepwise, lasso, and random forest regression. We found that models developed from MLS and iPad data were equally capable of predicting AGB (NRMSE 26.6% and 29.3%, respectively) regardless of the variable subsets considered. We also found that stepwise regression regularly resulted in the lowest NRMSE. Structural variables were consistently selected during each modeling approach, while spectral variables were rarely included. Field‐based variables were important in linear regression models but were not included after variable selection within random forest models. These findings support the notion that remote sensing techniques offer a valid alternative to analog field‐based data collection methods. Together, our results demonstrate that data collected using a more widely available platform will perform similarly to a more costly option and outline a workflow for modeling AGB using remote sensing systems alone. 
    more » « less
  5. ; ; ; (, American Society of Mammologist)
    Ecologists have increasingly recognized opportunities to adapt and adopt methodologies and information originally intended for other purposes in a “data fusion” approach. Recently, there has been an influx of studies and training focused on using unmanned aerial vehicles (UAV’s) and remote sensing in wildlife research. Leveraging these technologies could supplement the often resource-intensive field approaches used to monitor population and habitat dynamics for forest dwelling species such as the snowshoe hare (Lepus americanus). Barriers remain, however, especially as agencies lacking the resources to collect data using UAV’s are restricted to freely available, not wildlife-specific, products. Furthermore, technologies may not be advanced enough to “see through” the canopy to the understory, relevant for species that rely on vegetation cover. We thereby conducted a case study to determine whether an approach outlined by previous authors could be successful, wherein the remote sensing products were accessible and originally collected for broader purposes. Our models did not adequately predict snowshoe hare fecal pellet numbers, pointing to deficiencies in the scale and type of available data derived from remote sensing. We also note potential shortcomings in non-invasive field techniques. Regardless, we maintain that open-access remotely sensed imagery is valuable when ground-truthed and combined with supplemental information, adding to knowledge within and beyond the fields of forestry and wildlife biology. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email