skip to main content


Title: Quantifying uncertainty in land-use land-cover classification using conformal statistics
Land-use land-cover (LULC) change is one of the most important anthropogenic threats to biodiversity and ecosystems integrity. As a result, the systematic generation of annual regional, national, and global LULC map products derived from the classification of satellite imagery data have become critical inputs for multiple scientific disciplines. The importance of quantifying pixel-level uncertainty to improve the robustness of downstream analyses has long been acknowledged but this practice is still not widely adopted in the generation of these LULC products. The lack of uncertainty quantification is likely due to the fact that most approaches that have been put forward for this task are too computationally intensive for large-scale analysis (e.g., bootstrapping). In this article, we describe how conformal statistics can be used to quantify pixel-level uncertainty in a way that is not computationally intensive, is statistically rigorous despite relying on few assumptions, and can be used together with any classification algorithm that produces class probabilities. Our simulation results show how the size of the predictive sets created by conformal statistics can be used as an indicator of classification uncertainty at the pixel level. Our analysis based on data from the Brazilian Amazon reveals that both forest and water have high certainty whereas pasture and the “natural (other)” category have substantial uncertainty. This information can guide additional ground-truth data collection and the resulting raster combining the LULC classification with the uncertainty results can be used to communicate in a transparent way to downstream users which classified pixels have high or low uncertainty. Given the importance of systematic LULC maps and uncertainty quantification, we believe that this approach will find wide use in the remote sensing community.  more » « less
Award ID(s):
2040819
NSF-PAR ID:
10504965
Author(s) / Creator(s):
; ;
Publisher / Repository:
ELSEVIER
Date Published:
Journal Name:
Remote Sensing of Environment
Volume:
295
Issue:
C
ISSN:
0034-4257
Page Range / eLocation ID:
113682
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Through integrating multi-source data including high-resolution remote sensing image-based land use and land cover (LULC) data, model-based land use products, and historical land archives, we reconstructed historical LULC at an annual time scale and 1 km x 1 km resolution in the contiguous United States (CONUS) from 1630 to 2020. Compared to other historical LULC datasets, our data can capture the major characters of LULC as well as provide more accurate information with higher spatial and temporal resolution. The LULC data can be used for regional studies in a wide range of topics including LULC impacts on the ecosystem, biodiversity, water resource, carbon and nitrogen cycles, and greenhouse gas emissions.

     
    more » « less
  2. Land use and land cover (LULC) can significantly alter river water, which can in turn have important impacts on downstream coastal ecosystems by delivering nutrients that promote marine eutrophication and hypoxia. Well-documented in temperate systems, less is known about the way land cover relates to water quality in low-lying coastal zones in the tropics. Here we evaluate the catchment LULC and the physical and chemical characteristics of six rivers that contribute flow into a seasonally hypoxic tropical bay in Bocas del Toro, Panama. From July 2019 to March 2020, we routinely surveyed eight physical and chemical characteristics (temperature, specific conductivity, salinity, pH, dissolved oxygen (DO), nitrate and nitrite, ammonium, and phosphate). Our goals were to determine how these physical and chemical characteristics of the rivers reflect the LULC, to compare the water quality of the focal rivers to rivers across Panama, and to discuss the potential impacts of river discharge in the Bay. Overall, we found that the six focal rivers have significantly different river water characteristics that can be linked to catchment LULC and that water quality of rivers 10 s of kilometers apart could differ drastically. Two focal catchments dominated by pristine peat swamp vegetation in San San Pond Sak, showed characteristics typical of blackwater rivers, with low pH, dissolved oxygen, and nutrients. The remaining four catchments were largely mountainous with >50% forest cover. In these rivers, variation in nutrient concentrations were associated with percent urbanization. Comparisons across Panamanian rivers covered in a national survey to our focal rivers shows that saltwater intrusions and low DO of coastal swamp rivers may result in their classification by a standardized water quality index as having slightly contaminated water quality, despite this being their natural state. Examination of deforestation over the last 20 years, show that changes were <10% in the focal catchments, were larger in the small mountainous catchments and suggest that in the past 20 years the physical and chemical characteristics of river water that contributes to Almirante Bay may have shifted slightly in response to these moderate land use changes. (See supplementary information for Spanish-language abstract). 
    more » « less
  3. Abstract

    Calibrating land surface models and accurately quantifying their uncertainty are crucial for improving the reliability of simulations of complex environmental processes. This, in turn, advances our predictive understanding of ecosystems and supports climate‐resilient decision‐making. Traditional calibration methods, however, face challenges of high computational costs and difficulties in accurately quantifying parameter uncertainties. To address these issues, we develop a diffusion‐based uncertainty quantification (DBUQ) method. Unlike conventional generative diffusion methods, which are computationally expensive and memory‐intensive, DBUQ innovates by formulating a parameterized generative model and approximates this model through supervised learning, which enables quick generation of parameter posterior samples to quantify its uncertainty. DBUQ is effective, efficient, and general‐purpose, making it suitable for site‐specific ecosystem model calibration and broadly applicable for parameter uncertainty quantification across various earth system models. In this study, we applied DBUQ to calibrate the Energy Exascale Earth System Model land model at the Missouri Ozark AmeriFlux forest site. Results indicated that DBUQ produced accurate parameter posterior distributions similar to those from Markov Chain Monte Carlo sampling but with 30 times less computing time. This significant improvement in efficiency suggests that DBUQ can enable rapid, site‐level model calibration at a global scale, enhancing our predictive understanding of climate impacts on terrestrial ecosystems.

     
    more » « less
  4. Land is a natural resource that humans have utilized for life and various activities. Land use/land cover change (LULCC) has been of great concern to many countries over the years. Some of the main reasons behind LULCC are rapid population growth, migration, and the conversion of rural to urban areas. LULC has a considerable impact on the land-atmosphere/climate interactions. Over the past two decades, numerous studies conducted in LULC have investigated various areas of the field of LULC. However, the assemblage of information is missing for some aspects. Therefore, to provide coherent guidance, a literature review to scrutinize and evaluate many studies in particular topical areas is employed. This research study collected approximately four hundred research articles and investigated five (5) areas of interest, including (1) LULC definitions; (2) classification systems used to classify LULC globally; (3) direct and indirect changes of meta-studies associated with LULC; (4) challenges associated with LULC; and (5) LULC knowledge gaps. The synthesis revealed that LULC definitions carried vital terms, and classification systems for LULC are at the national, regional, and global scales. Most meta-studies for LULC were in the categories of direct and indirect land changes. Additionally, the analysis showed significant areas of LULC challenges were data consistency and quality. The knowledge gaps highlighted a fall in the categories of ecosystem services, forestry, and data/image modeling in LULC. Core findings exhibit common patterns, discrepancies, and relationships from the multiple studies. While literature review as a tool showed similarities among various research studies, our results recommend researchers endeavor to perform further synthesis in the field of LULC to promote our overall understanding, since research investigations will continue in LULC. 
    more » « less
  5. Land-use and land-cover (LULC) change is a primary driver of terrestrial carbon release, often through the conversion of forest into agriculture or expansion of urban areas. Classification schemes are a key component of landscape analyses. This study creates a novel LULC classification scheme by incorporating ecological data to redefine classes of an existing LULC classification based on variation in above-ground tree carbon. A tree inventory was conducted for 531 plots within a subbasin of the Tampa Bay Watershed, Florida, USA. Above-ground tree carbon was estimated using the i-Tree model. Plots were classified using the Florida Land Use Cover Classification System. Mean quantities of above-ground tree carbon, by class, were tested for statistical differences. A reclassification was conducted based on these differences. Sub-classes within a given “land cover” class were similar for six of the seven classes. Significant differences were found within the “Wetlands” class based on vegetation cover, forming two distinct groups: “Forested Wetlands” and “Non-forested and Mangrove Wetlands”. The urban “land use” class showed differences between “Residential” and “Non-residential” sub-classes, forming two new classes. LULC classifications can sometimes aggregate areas perceived as similar that are in fact distinct regarding ecological variables. These aggregations can obscure the true variation in a parameter at the landscape scale. Therefore, a study’s classification system should be designed to reflect landscape variation in the parameter(s) of interest. 
    more » « less