skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Photogrammetry and Augmented Reality for Underground Infrastructure Sensing, Mapping and Assessment
Digital three-dimensional (3-D) information concerning the location and condition of subsurface urban infrastructure is emerging as a potential new paradigm for aiding in the assessment, construction, emergency response, management, and planning of these vital assets. Subsurface infrastructure encompasses utilities (water, stormwater, wastewater, gas, electricity, telecommunications, steam, etc.), geotechnical formations, and the built underground (including tunnels, subways, garages and subsurface buildings). Traditional approaches for collecting location information include merging as-built drawings, historical records, and dead reckoning; and combining with information gathered by above-ground geophysical instruments, such as ground penetrating radars, magnetometers and acoustic sensors. This paper presents results of efforts aimed at using photogrammetric and augmented reality (AR) techniques to aid collecting, processing, and presenting 3-D location information.  more » « less
Award ID(s):
1640687 1647095
PAR ID:
10128860
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
International Conference on Smart Infrastructure and Construction 2019 (ICSIC): Driving data-informed decision-making
Page Range / eLocation ID:
169 to 175
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Urban areas increasingly suffer from subsurface heat islands: an underground climate change responsible for environmental, public health, and transportation issues. Soils, rocks, and construction materials deform under the influence of temperature variations and excessive deformations can affect the performance of civil infrastructure. Here I explore if ground deformations caused by subsurface heat islands might affect civil infrastructure. The Chicago Loop district is used as a case study. A 3-D computer model informed by data collected via a network of temperature sensors is used to characterize the ground temperature variations, deformations, and displacements caused by underground climate change. These deformations and displacements are significant and, on a case-by-case basis, may be incompatible with the operational requirements of civil structures. Therefore, the impact of underground climate change on civil infrastructure should be considered in future urban planning strategies to avoid possible structural damage and malfunction. Overall, this work suggests that underground climate change can represent a silent hazard for civil infrastructure in the Chicago Loop and other urban areas worldwide, but also an opportunity to reutilize or minimize waste heat in the ground. 
    more » « less
  2. The ground beneath many urban areas worldwide is warming up due to so-called subsurface urban heat islands. Resulting from localized and large-scale drivers of heat in the underground, subsurface heat islands cause thermally induced deformations of key materials constituting civil infrastructure: soils, rocks, concrete, and systems thereof. Currently, the effects of thermally induced deformations driven by subsurface heat islands on the performance and durability of civil infrastructure remain poorly understood. This paper presents the results of a numerical and experimental study to shed light on the impacts of subsurface urban heat islands on civil infrastructure. The study is based on the first 3-D model of the subsurface characterizing the central business district of Chicago, called the Loop, which is affected by an underground climate change. This numerical model is used in combination with temperature data gathered through a sensing network deployed across the Loop district to run thermo-hydro-mechanical simulations of the current subsurface conditions, highlighting satisfactory capabilities to model reality. Based on the analysis of the current subsurface conditions, numerical predictions are run over fifty years to reproduce the influence of heat flows on the deformation of the subsurface. The obtained results indicate that subsurface urban heat islands can involve noteworthy and potentially detrimental effects on the performance and durability of civil infrastructure, requiring consideration in the design of such structures or mitigation through appropriate strategies. An analysis of such strategies is proposed and perspectives to hamper this silent hazard for urban areas are provided. 
    more » « less
  3. Rapid global warming is catalyzing widespread permafrost degradation in the Arctic, leading to destructive land-surface subsidence that destabilizes and deforms the ground. Consequently, human-built infrastructure constructed upon permafrost is currently at major risk of structural failure. Risk assessment frameworks that attempt to study this issue assume that precise information on the location and extent of infrastructure is known. However, complete, high-quality, uniform geospatial datasets of built infrastructure that are readily available for such scientific studies are lacking. While imagery-enabled mapping can fill this knowledge gap, the small size of individual structures and vast geographical extent of the Arctic necessitate large volumes of very high spatial resolution remote sensing imagery. Transforming this ‘big’ imagery data into ‘science-ready’ information demands highly automated image analysis pipelines driven by advanced computer vision algorithms. Despite this, previous fine resolution studies have been limited to manual digitization of features on locally confined scales. Therefore, this exploratory study serves as the first investigation into fully automated analysis of sub-meter spatial resolution satellite imagery for automated detection of Arctic built infrastructure. We tasked the U-Net, a deep learning-based semantic segmentation model, with classifying different infrastructure types (residential, commercial, public, and industrial buildings, as well as roads) from commercial satellite imagery of Utqiagvik and Prudhoe Bay, Alaska. We also conducted a systematic experiment to understand how image augmentation can impact model performance when labeled training data is limited. When optimal augmentation methods were applied, the U-Net achieved an average F1 score of 0.83. Overall, our experimental findings show that the U-Net-based workflow is a promising method for automated Arctic built infrastructure detection that, combined with existing optimized workflows, such as MAPLE, could be expanded to map a multitude of infrastructure types spanning the pan-Arctic. 
    more » « less
  4. Chang, Fu-Kuo; Guemes, Alfredo (Ed.)
    This paper addresses the problem of monitoring structures with potential emergent damage through adaptive sensing provided by teams of mobile robots. Advantages of mobile robot teams for structural health monitoring include: 1. Multiple views of a given structure, 2. Adaptive movements that focus attention in response to observed conditions,3. Heterogeneous sensing and movement, and 4. Federated health monitoring and prognosis assessment through networked sharing and processing of information. Towards this end three cases of the use of mobile robot teams will be presented: 1. Heterogeneous robot teams for home and small building maintenance – Identifying, diagnosing and mitigating damage to homes and small buildings is a vexing set of problems for the owners. As an aid small controlled bristlebots and quadruped robot dogs (QRDs) carry sensors throughout a small building, assess conditions, provide prognoses and networked links to repair options; 2. Culverts are primary components of stormwater and flood prevention infrastructure. Inspecting small culverts is difficult for humans and large culverts are accessible but dangerous due to issues of confined spaces. Low-cost mobile robots have emerged as a competitive inspection option for accessible culverts with straight or short runs that permit wireless telemetry. Longer culverts and those with bends, branches and drop inlets pose challenges to the telemetry. Teams of robots extend the range of inspection through multi-hop video and control telemetry; 3. Ground penetrating radar (GPR) is a method of sensing subsurface infrastructure conditions with high-frequency electromagnetic waves. Conventional GPRs operate in a suboptimal monostatic or bistatic mode, are tedious to operate and have limitations in sensing congested utility subsurface conditions. Coordinated multistatic ground penetrating radar operated with mobile robot teams alleviates some of these concerns and provide better subsurface assessments with automated methods that focus attention on subsurface features of interest. Results from laboratory and field tests of these robot teams, as well as organizing principles of control and automated information processing are presented. 
    more » « less
  5. Abstract The Húsavík‐Flatey Fault Zone (HFFZ) is the largest strike‐slip fault in Iceland and poses a high seismic risk to coastal communities. To investigate physics‐based constraints on earthquake hazards, we construct three fault system models of varying geometric complexity and model 79 3‐D multi‐fault dynamic rupture scenarios in the HFFZ. By assuming a simple regional prestress and varying hypocenter locations, we analyze the rupture dynamics, fault interactions, and the associated ground motions up to 2.5 Hz. All models account for regional seismotectonics, topo‐bathymetry, 3‐D subsurface velocity, viscoelastic attenuation, and off‐fault plasticity, and we explore the effect of fault roughness. The rupture scenarios obey earthquake scaling relations and predict magnitudes comparable to those of historical events. We show how fault system geometry and segmentation, hypocenter location, and prestress can affect the potential for rupture cascading, leading to varying slip distributions across different portions of the fault system. Our earthquake scenarios yield spatially heterogeneous near‐field ground motions modulated by geometric complexities, topography, and rupture directivity, particularly in the near‐field. The average ground motion attenuation characteristics of dynamic rupture scenarios of comparable magnitudes and mean stress drop are independent of variations in source complexity, magnitude‐consistent and in good agreement with the latest regional empirical ground motion models. However, physics‐based ground motion variability changes considerably with fault‐distance and increases for unilateral compared to bilateral ruptures. Systematic variations in physics‐based near‐fault ground motions provide important insights into the mechanics and potential earthquake hazard of large strike‐slip fault systems, such as the HFFZ. 
    more » « less