skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Hyperparameter Optimization for Large-Scale Remote Sensing Image Analysis Tasks: A Case Study Based on Permafrost Landform Detection Using Deep Learning
Title: Hyperparameter Optimization for Large-Scale Remote Sensing Image Analysis Tasks: A Case Study Based on Permafrost Landform Detection Using Deep Learning
Climate change pressure on the Arctic permafrost is rising alarmingly, creating a decisive need to produce Pan-Arctic scale permafrost landform and thaw disturbance information from remote sensing (RS) data. Very high spatial resolution (VHSR) satellite images can be utilized to detect ice-wedge polygons (IWPs) – the most important and widespread landform in the Arctic tundra region - across the Arctic without compromising spatial details. Automated analysis of peta-byte scale VHSR imagery covering millions of square kilometers is a computationally challenging task. Traditional semantic segmentation requires the use of task specific feature extraction with conventional classification techniques. Semantic complexity of VHSR images coupled with landscape heterogeneity makes it difficult to use conventional classification approaches to produce Pan-Arctic scale geospatial products. This leads to adapting deep convolutional neural network (DLCNN) approaches that have excelled in computer vision (CV) applications. Transitioning domains from everyday image understanding to remote sensing image analysis is challenging. This study aims to systematically investigate two main obstacles confronted when adapting DLCNNs in large-scale RS image analysis tasks; 1) the limited availability labeled data sets and 2) the prohibitive nature of hyperparameter tunning when designing DLCNNs that can capture the rich characteristics embedded in remotely-sensed images. With a case study on the production of the first pan-Arctic ice-wedge polygon map using thousands of VHSR images, we demonstrate the use of transfer learning and the impact of hyperparameter tuning with a 16% improvement of the Mean Average Precision (mAP50).  more » « less
Award ID(s):
1927720
PAR ID:
10580104
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IEEE Access
Date Published:
Journal Name:
IEEE Access
Volume:
12
ISSN:
2169-3536
Page Range / eLocation ID:
43062 to 43077
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences)
    Abstract. Permafrost thaw has been observed at several locations across the Arctic tundra in recent decades; however, the pan-Arctic extent and spatiotemporal dynamics of thaw remains poorly explained. Thaw-induced differential ground subsidence and dramatic microtopographic transitions, such as transformation of low-centered ice-wedge polygons (IWPs) into high-centered IWPs can be characterized using very high spatial resolution (VHSR) commercial satellite imagery. Arctic researchers demand for an accurate estimate of the distribution of IWPs and their status across the tundra domain. The entire Arctic has been imaged in 0.5 m resolution by commercial satellite sensors; however, mapping efforts are yet limited to small scales and confined to manual or semi-automated methods. Knowledge discovery through artificial intelligence (AI), big imagery, and high performance computing (HPC) resources is just starting to be realized in Arctic science. Large-scale deployment of VHSR imagery resources requires sophisticated computational approaches to automated image interpretation coupled with efficient use of HPC resources. We are in the process of developing an automated Mapping Application for Permafrost Land Environment (MAPLE) by combining big imagery, AI, and HPC resources. The MAPLE uses deep learning (DL) convolutional neural nets (CNNs) algorithms on HPCs to automatically map IWPs from VHSR commercial satellite imagery across large geographic domains. We trained and tasked a DLCNN semantic object instance segmentation algorithm to automatically classify IWPs from VHSR satellite imagery. Overall, our findings demonstrate the robust performances of IWP mapping algorithm in diverse tundra landscapes and lay a firm foundation for its operational-level application in repeated documentation of circumpolar permafrost disturbances. 
    more » « less
  2. ; ; ; (, Remote Sensing)
    The microtopography associated with ice-wedge polygons governs many aspects of Arctic ecosystem, permafrost, and hydrologic dynamics from local to regional scales owing to the linkages between microtopography and the flow and storage of water, vegetation succession, and permafrost dynamics. Wide-spread ice-wedge degradation is transforming low-centered polygons into high-centered polygons at an alarming rate. Accurate data on spatial distribution of ice-wedge polygons at a pan-Arctic scale are not yet available, despite the availability of sub-meter-scale remote sensing imagery. This is because the necessary spatial detail quickly produces data volumes that hamper both manual and semi-automated mapping approaches across large geographical extents. Accordingly, transforming big imagery into ‘science-ready’ insightful analytics demands novel image-to-assessment pipelines that are fueled by advanced machine learning techniques and high-performance computational resources. In this exploratory study, we tasked a deep-learning driven object instance segmentation method (i.e., the Mask R-CNN) with delineating and classifying ice-wedge polygons in very high spatial resolution aerial orthoimagery. We conducted a systematic experiment to gauge the performances and interoperability of the Mask R-CNN across spatial resolutions (0.15 m to 1 m) and image scene contents (a total of 134 km2) near Nuiqsut, Northern Alaska. The trained Mask R-CNN reported mean average precisions of 0.70 and 0.60 at thresholds of 0.50 and 0.75, respectively. Manual validations showed that approximately 95% of individual ice-wedge polygons were correctly delineated and classified, with an overall classification accuracy of 79%. Our findings show that the Mask R-CNN is a robust method to automatically identify ice-wedge polygons from fine-resolution optical imagery. Overall, this automated imagery-enabled intense mapping approach can provide a foundational framework that may propel future pan-Arctic studies of permafrost thaw, tundra landscape evolution, and the role of high latitudes in the global climate system. 
    more » « less
  3. ; ; ; ; ; ; ; ; (, Journal of Imaging)
    Deep learning (DL) convolutional neural networks (CNNs) have been rapidly adapted in very high spatial resolution (VHSR) satellite image analysis. DLCNN-based computer visions (CV) applications primarily aim for everyday object detection from standard red, green, blue (RGB) imagery, while earth science remote sensing applications focus on geo object detection and classification from multispectral (MS) imagery. MS imagery includes RGB and narrow spectral channels from near- and/or middle-infrared regions of reflectance spectra. The central objective of this exploratory study is to understand to what degree MS band statistics govern DLCNN model predictions. We scaffold our analysis on a case study that uses Arctic tundra permafrost landform features called ice-wedge polygons (IWPs) as candidate geo objects. We choose Mask RCNN as the DLCNN architecture to detect IWPs from eight-band Worldview-02 VHSR satellite imagery. A systematic experiment was designed to understand the impact on choosing the optimal three-band combination in model prediction. We tasked five cohorts of three-band combinations coupled with statistical measures to gauge the spectral variability of input MS bands. The candidate scenes produced high model detection accuracies for the F1 score, ranging between 0.89 to 0.95, for two different band combinations (coastal blue, blue, green (1,2,3) and green, yellow, red (3,4,5)). The mapping workflow discerned the IWPs by exhibiting low random and systematic error in the order of 0.17–0.19 and 0.20–0.21, respectively, for band combinations (1,2,3). Results suggest that the prediction accuracy of the Mask-RCNN model is significantly influenced by the input MS bands. Overall, our findings accentuate the importance of considering the image statistics of input MS bands and careful selection of optimal bands for DLCNN predictions when DLCNN architectures are restricted to three spectral channels. 
    more » « less
  4. ; ; (, NSF Arctic Data Center)
    Ice-wedge polygon (IWP) is a landform found in landscapes underlain by permafrost. IWPs form due to the development of ice wedges, where each IWP is bounded by ice wedges. Ice wedges form due to repeated cracking of the soil during winter and by snowmelt water infiltrating into the cracks and freezing. Repeated over thousands of years, the process results in ice wedges several 10s of feet deep. The melting of the top of the ice wedge results in ground subsidence and depending how extensive the thaw is across the landscape, new ponds or lateral drainage channels form. This data collection supported an assessment of the length of the ice wedge network in the Barnard River watershed (10,540 km2), Banks Island, Canada. The data collection is derived from the pan-Arctic map of ice-wedge polygons (Witharana et al. 2023, Ice-wedge polygon detection in satellite imagery from pan-Arctic regions, Permafrost Discovery Gateway, 2001-2021. Arctic Data Center. doi:10.18739/A2KW57K57), which used Maxar satellite imagery from 2010-2020 for Banks Island. Two types of datasets are included: (1) Polyline shapefile of mapped ice wedge centerlines. This dataset was produced with an approach adopted from Ulrich, Mathias, et al. "Quantifying wedge‐ice volumes in Yedoma and thermokarst basin deposits." Permafrost and Periglacial Processes 25.3 (2014): 151-161. A buffer that represents widths at the top of ice wedges is created around each IWP. A buffer width of 5 meters was chosen, since this allowed buffers of adjacent polygons to overlap. These buffers are then skeletonized in order to trace their centerlines, which ultimately represents the network of ice-wedges that form the IWPs in a landscape. (2) Polygon shapefile of IWP coverage (as percentage of land cover within 1 kilometer (km) x 1 km rectangular grid cells) across the 10,540 km2 Bernard River Watershed, Banks Island, Canada. Code for ice-wedge centerline extraction can be found at https://github.com/PermafrostDiscoveryGateway/IW-Network-Extraction. This data collection accompanies the manuscript published in Nature Water (Liljedahl, A.K., Witharana, C., and Manos, E., 2024. The Capillaries of the Arctic Tundra. Nature Water, doi:10.1038/s44221-024-00276-9) and the geospatial data is available to view in the Permafrost Discovery Gateway. 
    more » « less
  5. (, NSF Arctic Data Center)
    This dataset documents changes in infrastructure development and associated ice wedge thermokarst formation in Point Lay (Kali), Alaska, between 1949 and 2020. The data include vector-based Geographic Information System (GIS) layers derived from high-resolution remote sensing imagery and historical aerial photographs for three key time points: 1949, 1974, and 2019/20. Infrastructure features (e.g., roads, runways, gravel pads, and buildings) were manually digitized, and the extent of ice wedge thermokarst was mapped using detailed image interpretation techniques at 1:500 scale. The dataset supports spatial analysis of thermokarst expansion in relation to anthropogenic disturbance and surface development. Findings reveal a near tenfold increase in ice wedge thermokarst extent in developed areas between 1974 and 2019, with minimal changes in adjacent undisturbed tundra, underscoring the synergistic impact of infrastructure and climate warming on permafrost degradation. These data provide a valuable baseline for tracking permafrost-related landscape changes and informing adaptation strategies in Arctic communities experiencing thaw-related infrastructure challenges. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email