An official website of the United States government
Airborne remote sensing offers unprecedented opportunities to efficiently monitor vegetation, but methods to delineate and classify individual plant species using the collected data are still actively being developed and improved. The Integrating Data science with Trees and Remote Sensing (IDTReeS) plant identification competition openly invited scientists to create and compare individual tree mapping methods. Participants were tasked with training taxon identification algorithms based on two sites, to then transfer their methods to a third unseen site, using field-based plant observations in combination with airborne remote sensing image data products from the National Ecological Observatory Network (NEON). These data were captured by a high resolution digital camera sensitive to red, green, blue (RGB) light, hyperspectral imaging spectrometer spanning the visible to shortwave infrared wavelengths, and lidar systems to capture the spectral and structural properties of vegetation. As participants in the IDTReeS competition, we developed a two-stage deep learning approach to integrate NEON remote sensing data from all three sensors and classify individual plant species and genera. The first stage was a convolutional neural network that generates taxon probabilities from RGB images, and the second stage was a fusion neural network that “learns” how to combine these probabilities with hyperspectral and lidar data. Our two-stage approach leverages the ability of neural networks to flexibly and automatically extract descriptive features from complex image data with high dimensionality. Our method achieved an overall classification accuracy of 0.51 based on the training set, and 0.32 based on the test set which contained data from an unseen site with unknown taxa classes. Although transferability of classification algorithms to unseen sites with unknown species and genus classes proved to be a challenging task, developing methods with openly available NEON data that will be collected in a standardized format for 30 years allows for continual improvements and major gains for members of the computational ecology community. We outline promising directions related to data preparation and processing techniques for further investigation, and provide our code to contribute to open reproducible science efforts.
more »
« less
Capturing patterns of evolutionary relatedness with reflectance spectra to model and monitor biodiversity
Biogeographic history can set initial conditions for vegetation community assemblages that determine their climate responses at broad extents that land surface models attempt to forecast. Numerous studies have indicated that evolutionarily conserved biochemical, structural, and other functional attributes of plant species are captured in visible-to-short wavelength infrared, 400 to 2,500 nm, reflectance properties of vegetation. Here, we present a remotely sensed phylogenetic clustering and an evolutionary framework to accommodate spectra, distributions, and traits. Spectral properties evolutionarily conserved in plants provide the opportunity to spatially aggregate species into lineages (interpreted as “lineage functional types” or LFT) with improved classification accuracy. In this study, we use Airborne Visible/Infrared Imaging Spectrometer data from the 2013 Hyperspectral Infrared Imager campaign over the southern Sierra Nevada, California flight box, to investigate the potential for incorporating evolutionary thinking into landcover classification. We link the airborne hyperspectral data with vegetation plot data from 1372 surveys and a phylogeny representing 1,572 species. Despite temporal and spatial differences in our training data, we classified plant lineages with moderate reliability (Kappa = 0.76) and overall classification accuracy of 80.9%. We present an assessment of classification error and detail study limitations to facilitate future LFT development. This work demonstrates that lineage-based methods may be a promising way to leverage the new-generation high-resolution and high return-interval hyperspectral data planned for the forthcoming satellite missions with sparsely sampled existing ground-based ecological data.
more »
« less
- Award ID(s):
- 1926431
- PAR ID:
- 10500960
- Publisher / Repository:
- PNAS
- Date Published:
- Journal Name:
- Proceedings of the National Academy of Sciences
- Volume:
- 120
- Issue:
- 24
- ISSN:
- 0027-8424
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Alaska has witnessed a significant increase in wildfire events in recent decades that have been linked to drier and warmer summers. Forest fuel maps play a vital role in wildfire management and risk assessment. Freely available multispectral datasets are widely used for land use and land cover mapping, but they have limited utility for fuel mapping due to their coarse spectral resolution. Hyperspectral datasets have a high spectral resolution, ideal for detailed fuel mapping, but they are limited and expensive to acquire. This study simulates hyperspectral data from Sentinel-2 multispectral data using the spectral response function of the Airborne Visible/Infrared Imaging Spectrometer-Next Generation (AVIRIS-NG) sensor, and normalized ground spectra of gravel, birch, and spruce. We used the Uniform Pattern Decomposition Method (UPDM) for spectral unmixing, which is a sensor-independent method, where each pixel is expressed as the linear sum of standard reference spectra. The simulated hyperspectral data have spectral characteristics of AVIRIS-NG and the reflectance properties of Sentinel-2 data. We validated the simulated spectra by visually and statistically comparing it with real AVIRIS-NG data. We observed a high correlation between the spectra of tree classes collected from AVIRIS-NG and simulated hyperspectral data. Upon performing species level classification, we achieved a classification accuracy of 89% for the simulated hyperspectral data, which is better than the accuracy of Sentinel-2 data (77.8%). We generated a fuel map from the simulated hyperspectral image using the Random Forest classifier. Our study demonstrated that low-cost and high-quality hyperspectral data can be generated from Sentinel-2 data using UPDM for improved land cover and vegetation mapping in the boreal forest.more » « less
-
Abstract Hyperspectral remote sensing has the potential to map numerous attributes of the Earth’s surface, including spatial patterns of biological diversity. Grasslands are one of the largest biomes on Earth. Accurate mapping of grassland biodiversity relies on spectral discrimination of endmembers of species or plant functional types. We focused on spectral separation of grass lineages that dominate global grassy biomes: Andropogoneae (C4), Chloridoideae (C4), and Pooideae (C3). We examined leaf reflectance spectra (350–2,500 nm) from 43 grass species representing these grass lineages from four representative grassland sites in the Great Plains region of North America. We assessed the utility of leaf reflectance data for classification of grass species into three major lineages and by collection site. Classifications had very high accuracy (94%) that were robust to site differences in species and environment. We also show an information loss using multispectral sensors, that is, classification accuracy of grass lineages using spectral bands provided by current multispectral satellites is much lower (accuracy of 85.2% and 61.3% using Sentinel 2 and Landsat 8 bands, respectively). Our results suggest that hyperspectral data have an exciting potential for mapping grass functional types as informed by phylogeny. Leaf‐level hyperspectral separability of grass lineages is consistent with the potential increase in biodiversity and functional information content from the next generation of satellite‐based spectrometers.more » « less
-
Abstract Background Remote sensing instruments enable high-throughput phenotyping of plant traits and stress resilience across scale. Spatial (handheld devices, towers, drones, airborne, and satellites) and temporal (continuous or intermittent) tradeoffs can enable or constrain plant science applications. Here, we describe the technical details of TSWIFT (Tower Spectrometer on Wheels for Investigating Frequent Timeseries), a mobile tower-based hyperspectral remote sensing system for continuous monitoring of spectral reflectance across visible-near infrared regions with the capacity to resolve solar-induced fluorescence (SIF). Results We demonstrate potential applications for monitoring short-term (diurnal) and long-term (seasonal) variation of vegetation for high-throughput phenotyping applications. We deployed TSWIFT in a field experiment of 300 common bean genotypes in two treatments: control (irrigated) and drought (terminal drought). We evaluated the normalized difference vegetation index (NDVI), photochemical reflectance index (PRI), and SIF, as well as the coefficient of variation (CV) across the visible-near infrared spectral range (400 to 900 nm). NDVI tracked structural variation early in the growing season, following initial plant growth and development. PRI and SIF were more dynamic, exhibiting variation diurnally and seasonally, enabling quantification of genotypic variation in physiological response to drought conditions. Beyond vegetation indices, CV of hyperspectral reflectance showed the most variability across genotypes, treatment, and time in the visible and red-edge spectral regions. Conclusions TSWIFT enables continuous and automated monitoring of hyperspectral reflectance for assessing variation in plant structure and function at high spatial and temporal resolutions for high-throughput phenotyping. Mobile, tower-based systems like this can provide short- and long-term datasets to assess genotypic and/or management responses to the environment, and ultimately enable the spectral prediction of resource-use efficiency, stress resilience, productivity and yield.more » « less
-
Summary Process‐based vegetation models attempt to represent the wide range of trait variation in biomes by grouping ecologically similar species into plant functional types (PFTs). This approach has been successful in representing many aspects of plant physiology and biophysics but struggles to capture biogeographic history and ecological dynamics that determine biome boundaries and plant distributions. Grass‐dominated ecosystems are broadly distributed across all vegetated continents and harbour large functional diversity, yet most Land Surface Models (LSMs) summarise grasses into two generic PFTs based primarily on differences between temperate C3grasses and (sub)tropical C4grasses. Incorporation of species‐level trait variation is an active area of research to enhance the ecological realism of PFTs, which form the basis for vegetation processes and dynamics in LSMs. Using reported measurements, we developed grass functional trait values (physiological, structural, biochemical, anatomical, phenological, and disturbance‐related) of dominant lineages to improve LSM representations. Our method is fundamentally different from previous efforts, as it uses phylogenetic relatedness to create lineage‐based functional types (LFTs), situated between species‐level trait data and PFT‐level abstractions, thus providing a realistic representation of functional diversity and opening the door to the development of new vegetation models.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1073/pnas.2215533120
