An official website of the United States government
Retrogressive thaw slumps (RTS) are considered one of the most dynamic permafrost disturbance features in the Arctic. Sub-meter resolution multispectral imagery acquired by very high spatial resolution (VHSR) commercial satellite sensors offer unique capacities in capturing the morphological dynamics of RTSs. The central goal of this study is to develop a deep learning convolutional neural net (CNN) model (a UNet-based workflow) to automatically detect and characterize RTSs from VHSR imagery. We aimed to understand: (1) the optimal combination of input image tile size (array size) and the CNN network input size (resizing factor/spatial resolution) and (2) the interoperability of the trained UNet models across heterogeneous study sites based on a limited set of training samples. Hand annotation of RTS samples, CNN model training and testing, and interoperability analyses were based on two study areas from high-Arctic Canada: (1) Banks Island and (2) Axel Heiberg Island and Ellesmere Island. Our experimental results revealed the potential impact of image tile size and the resizing factor on the detection accuracies of the UNet model. The results from the model transferability analysis elucidate the effects on the UNet model due the variability (e.g., shape, color, and texture) associated with the RTS training samples. Overall, study findings highlight several key factors that we should consider when operationalizing CNN-based RTS mapping over large geographical extents.
more »
« less
Developing and Testing a Deep Learning Approach for Mapping Retrogressive Thaw Slumps
In a warming Arctic, permafrost-related disturbances, such as retrogressive thaw slumps (RTS), are becoming more abundant and dynamic, with serious implications for permafrost stability and bio-geochemical cycles on local to regional scales. Despite recent advances in the field of earth observation, many of these have remained undetected as RTS are highly dynamic, small, and scattered across the remote permafrost region. Here, we assessed the potential strengths and limitations of using deep learning for the automatic segmentation of RTS using PlanetScope satellite imagery, ArcticDEM and auxiliary datasets. We analyzed the transferability and potential for pan-Arctic upscaling and regional cross-validation, with independent training and validation regions, in six different thaw slump-affected regions in Canada and Russia. We further tested state-of-the-art model architectures (UNet, UNet++, DeepLabv3) and encoder networks to find optimal model configurations for potential upscaling to continental scales. The best deep learning models achieved mixed results from good to very good agreement in four of the six regions (maxIoU: 0.39 to 0.58; Lena River, Horton Delta, Herschel Island, Kolguev Island), while they failed in two regions (Banks Island, Tuktoyaktuk). Of the tested architectures, UNet++ performed the best. The large variance in regional performance highlights the requirement for a sufficient quantity, quality and spatial variability in the training data used for segmenting RTS across diverse permafrost landscapes, in varying environmental conditions. With our highly automated and configurable workflow, we see great potential for the transfer to active RTS clusters (e.g., Peel Plateau) and upscaling to much larger regions.
more »
« less
- PAR ID:
- 10302241
- Date Published:
- Journal Name:
- Remote Sensing
- Volume:
- 13
- Issue:
- 21
- ISSN:
- 2072-4292
- Page Range / eLocation ID:
- 4294
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The accelerated warming conditions of the high Arctic have intensified the extensive thawing of permafrost. Retrogressive thaw slumps (RTSs) are considered as the most active landforms in the Arctic permafrost. An increase in RTSs has been observed in the Arctic in recent decades. Continuous monitoring of RTSs is important to understand climate change-driven disturbances in the region. Manual detection of these landforms is extremely difficult as they occur over exceptionally large areas. Only very few studies have explored the utility of very high spatial resolution (VHSR) commercial satellite imagery in the automated mapping of RTSs. We have developed deep learning (DL) convolution neural net (CNN) based workflow to automatically detect RTSs from VHRS satellite imagery. This study systematically compared the performance of different DLCNN model architectures and varying backbones. Our candidate CNN models include: DeepLabV3+, UNet, UNet++, Multi-scale Attention Net (MA-Net), and Pyramid Attention Network (PAN) with ResNet50, ResNet101 and ResNet152 backbones. The RTS modeling experiment was conducted on Banks Island and Ellesmere Island in Canada. The UNet++ model demonstrated the highest accuracy (F1 score of 87%) with the ResNet50 backbone at the expense of training and inferencing time. PAN, DeepLabV3, MaNet, and UNet, models reported mediocre F1 scores of 72%, 75%, 80%, and 81% respectively. Our findings unravel the performances of different DLCNNs in imagery-enabled RTS mapping and provide useful insights on operationalizing the mapping application across the Arctic.more » « less
-
This dataset, called DARTS, comprises footprints of retrogressive thaw slump (RTS) identified and quantified using an automated deep learning approach in RTS hotspots across the Arctic and Subarctic permafrost regions. We utilized multispectral PlanetScope imagery with a spatial resolution of ~3 meters (m), complemented by ArcticDEM (Digital Elevation Model) and derived datasets, including slope, relative elevation, and Landsat-derived change trends. The dataset covers an area of 1.6 million square-kilometers (km²), with at least one coverage between 2021 and 2023, and provides annual coverage for approximately 900,000 km². In several highly active key sites, such as Banks Island, Peel Plateau, and Novaya Zemlya, we extended the data frequency and temporal coverage to 2018-2023. We mapped a total of more than 43,000 individual RTS and ALD, many of them multiple times. We offer two levels of datasets; Level 1: RTS footprints per image with timestamps; and Level 2: annually aggregated RTS footprints. Essential metadata includes image footprints, dataset coverage, timestamps, and model-specific information. To enhance reproducibility and further use, the training labels, processing code, and model checkpoints are publicly available. This version, v1.1, is the revised first openly accessible release. The dataset will be maintained and continuously updated in both spatial and temporal extent. It can be used for mapping and quantifying RTS, analyzing spatio-temporal patterns of RTS dynamics, or serving as input for landscape dynamics models.more » « less
-
This dataset, called DARTS, comprises footprints of retrogressive thaw slump (RTS) and active layer detachments slides (ALD) identified and quantified using an automated deep learning approach in RTS hotspots across the Arctic and Subarctic permafrost regions. We utilized multispectral PlanetScope imagery with a spatial resolution of 3 meters (m), complemented by ArcticDEM (Digital Elevation Models) and derived datasets, including slope, relative elevation, and Landsat-derived change trends. The dataset covers an area of 1.6 million square-kilometers (km²), with at least one coverage between 2021 and 2023, and provides annual coverage for approximately 900,000 km². In several highly active key sites, such as Banks Island, Peel Plateau, and Novaya Zemlya, we extended the data frequency and temporal coverage to 2018-2023. We mapped a total of more than 43,000 individual RTS and ALD, many of them multiple times. We offer two levels of datasets; Level 1: RTS footprints per image with timestamps; and Level 2: annually aggregated RTS footprints. Essential metadata includes image footprints, dataset coverage, timestamps, and model-specific information. To enhance reproducibility and further use, the training labels, processing code, and model checkpoints are publicly available. This version, v1, is the first openly accessible release. The dataset will be maintained and continuously updated in both spatial and temporal extent. It can be used for mapping and quantifying RTS, analyzing spatio-temporal patterns of RTS dynamics, or serving as input for landscape dynamics models.more » « less
-
ABSTRACT Deep‐learning (DL) models have become increasingly beneficial for the detection of retrogressive thaw slumps (RTS) in the permafrost domain. However, comparing accuracy metrics is challenging due to unstandardized labeling guidelines. To address this, we conducted an experiment with 12 international domain experts from a broad range of scientific backgrounds. Using 3 m PlanetScope multispectral imagery, they digitized RTS footprints in two sites. We evaluated label uncertainty by comparing manually outlined RTS labels using Intersection‐over‐Union (IoU) and F1 metrics. At the Canadian Peel Plateau site, we see good agreement, particularly in the active parts of RTS. Differences were observed in the interpretation of the debris tongue and the stable vegetated sections of RTS. At the Russian Bykovsky site, we observed a larger mismatch. Here, the same differences were documented, but several participants mistakenly identified non‐RTS features. This emphasizes the importance of site‐specific knowledge for reliable label creation. The experiment highlights the need for standardized labeling procedures and definition of their scientific purpose. The most similar expert labels outperformed the accuracy metrics reported in the literature, highlighting human labeling capabilities with proper training, site knowledge, and clear guidelines. These findings lay the groundwork for DL‐based RTS monitoring in the pan‐Arctic.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/rs13214294
