Title: Semi-Automated Semantic Segmentation of Arctic Shorelines Using Very High-Resolution Airborne Imagery, Spectral Indices and Weakly Supervised Machine Learning Approaches
Precise coastal shoreline mapping is essential for monitoring changes in erosion rates, surface hydrology, and ecosystem structure and function. Monitoring water bodies in the Arctic National Wildlife Refuge (ANWR) is of high importance, especially considering the potential for oil and natural gas exploration in the region. In this work, we propose a modified variant of the Deep Neural Network based U-Net Architecture for the automated mapping of 4 Band Orthorectified NOAA Airborne Imagery using sparsely labeled training data and compare it to the performance of traditional Machine Learning (ML) based approaches—namely, random forest, xgboost—and spectral water indices—Normalized Difference Water Index (NDWI), and Normalized Difference Surface Water Index (NDSWI)—to support shoreline mapping of Arctic coastlines. We conclude that it is possible to modify the U-Net model to accept sparse labels as input and the results are comparable to other ML methods (an Intersection-over-Union (IoU) of 94.86% using U-Net vs. an IoU of 95.05% using the best performing method).  more » « less
Award ID(s):
1927373 1836861
PAR ID:
10326050
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Remote Sensing
Date Published:
Journal Name:
Remote Sensing
Volume:
13
Issue:
22
ISSN:
2072-4292
Page Range / eLocation ID:
4572
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The Arctic coastline spans multiple countries, supports Indigenous livelihoods, and plays a vital role in the Arctic system. Rapid climate change is accelerating permafrost thaw, sea-level rise, and coastal erosion, underscoring the need for decision making to be informed by accurate delineation of tundra shoreline (instantaneous water line) and bluff edge (vegetation–slope boundary) position and change trends. To address this need, we compared two image segmentation approaches for mapping Arctic land and water interfaces from high-resolution satellite imagery. (1) U-Net, a supervised convolutional neural network trained on expert-annotated scenes, and (2) Differentiable Feature Clustering (DifFeat), an unsupervised model applied in a minimally supervised manner via expert-guided cluster selection. The shoreline and bluff edge boundaries were derived from the segmented land and water masks using an automated interface extraction approach. DifFeat achieved higher segmentation accuracy, with IoU values of 0.95 (water) and 0.92 (land), compared to U-Net’s 0.58 and 0.50, respectively. U-Net produced reliable results and benefited from infrared and vegetation spectral indices, but required extensive annotation and showed limited generalization to UAV imagery. DifFeat achieved superior results without manual annotation, reducing the dependence on labeled data and completing training 99.87% faster than U-Net. These findings highlight the complementary strengths of supervised and semi-supervised models for Arctic coastal mapping, with DifFeat offering a scalable, label-efficient solution for long-term coastal-change monitoring. Future work will integrate elevation data to further improve bluff edge feature detection. 
    more » « less
  2. This paper explores the problem of deploying machine learning (ML)-based object detection and segmentation models on edge platforms to enable realtime caveline detection for Autonomous Underwater Vehicles (AUVs) used for under-water cave exploration and mapping. We specifically investigate three ML models, i.e., U-Net, Vision Transformer (ViT), and YOLOv8, deployed on three edge platforms: Raspberry Pi-4, Intel Neural Compute Stick 2 (NCS2), and NVIDIA Jetson Nano. The experimental results unveil clear tradeoffs between model accuracy, processing speed, and energy consumption. The most accurate model has shown to be U-Net with an 85.53 F1-score and 85.38 Intersection Over Union (IoU) value. Meanwhile, the highest inference speed and lowest energy consumption are achieved by the YOLOv8 model deployed on Jetson Nano operating in the high-power and low-power modes, respectively. The comprehensive quantitative analyses and comparative results provided in the paper highlight important nuances that can guide the deployment of caveline detection systems on underwater robots for ensuring safe and reliable AUV navigation during underwater cave exploration and mapping missions. 
    more » « less
  3. Increased industrial development in the Arctic has led to a rapid expansion of infrastructure in the region. Localized impacts of infrastructure on snow distribution, road dust, and snowmelt timing and duration feeds back into the coupled Arctic system causing a series of cascading effects that remain poorly understood. We quantify spatial and temporal patterns of snow-off dates in the Prudhoe Bay Oilfield, Alaska, using Sentinel-2 data. We derive the Normalized Difference Snow Index to quantify snow persistence in 2019–2020. The Normalized Difference Vegetation Index and Normalized Difference Water Index were used to show linkages of vegetation and surface hydrology, in relationship to patterns of snowmelt. Newly available infrastructure data were used to analyze snowmelt patterns in relation infrastructure. Results show a relationship between snowmelt and distance to infrastructure varying by use and traffic load, and orientation relative to the prevailing wind direction (up to 1 month difference in snow-free dates). Post-snowmelt surface water area showed a strong negative correlation (up to −0.927) with distance to infrastructure. Results from field observations indicate an impact of infrastructure on winter near-surface ground temperature and snow depth. This study highlights the impact of infrastructure on a large area beyond the direct human footprint and the interconnectedness between snow-off timing, vegetation, surface hydrology, and near-surface ground temperatures. 
    more » « less
  4. This paper addresses the challenge of deploying machine learning (ML)-based segmentation models on edge platforms to facilitate real-time scene segmentation for Autonomous Underwater Vehicles (AUVs) in underwater cave exploration and mapping scenarios. We focus on three ML models-U-Net, CaveSeg, and YOLOv8n-deployed on four edge platforms: Raspberry Pi-4, Intel Neural Compute Stick 2 (NCS2), Google Edge TPU, and NVIDIA Jetson Nano. Experimental results reveal that mobile models with modern architectures, such as YOLOv8n, and specialized models for semantic segmentation, like U-Net, offer higher accuracy with lower latency. YOLOv8n emerged as the most accurate model, achieving a 72.5 Intersection Over Union (IoU) score. Meanwhile, the U-Net model deployed on the Coral Dev board delivered the highest speed at 79.24 FPS and the lowest energy consumption at 6.23 mJ. The detailed quantitative analyses and comparative results presented in this paper offer critical insights for deploying cave segmentation systems on underwater robots, ensuring safe and reliable AUV navigation during cave exploration and mapping missions. 
    more » « less
  5. This paper addresses the challenge of deploying machine learning (ML)-based segmentation models on edge platforms to facilitate real-time scene segmentation for Autonomous Underwater Vehicles (AUVs) in underwater cave exploration and mapping scenarios. We focus on three ML models-U-Net, CaveSeg, and YOLOv8n-deployed on four edge platforms: Raspberry Pi-4, Intel Neural Compute Stick 2 (NCS2), Google Edge TPU, and NVIDIA Jetson Nano. Experimental results reveal that mobile models with modern architectures, such as YOLOv8n, and specialized models for semantic segmentation, like U-Net, offer higher accuracy with lower latency. YOLOv8n emerged as the most accurate model, achieving a 72.5 Intersection Over Union (IoU) score. Meanwhile, the U-Net model deployed on the Coral Dev board delivered the highest speed at 79.24 FPS and the lowest energy consumption at 6.23 mJ. The detailed quantitative analyses and comparative results presented in this paper offer critical insights for deploying cave segmentation systems on underwater robots, ensuring safe and reliable AUV navigation during cave exploration and mapping missions. 
    more » « less