skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: GeoAI for Large-Scale Image Analysis and Machine Vision: Recent Progress of Artificial Intelligence in Geography
GeoAI, or geospatial artificial intelligence, has become a trending topic and the frontier for spatial analytics in Geography. Although much progress has been made in exploring the integration of AI and Geography, there is yet no clear definition of GeoAI, its scope of research, or a broad discussion of how it enables new ways of problem solving across social and environmental sciences. This paper provides a comprehensive overview of GeoAI research used in large-scale image analysis, and its methodological foundation, most recent progress in geospatial applications, and comparative advantages over traditional methods. We organize this review of GeoAI research according to different kinds of image or structured data, including satellite and drone images, street views, and geo-scientific data, as well as their applications in a variety of image analysis and machine vision tasks. While different applications tend to use diverse types of data and models, we summarized six major strengths of GeoAI research, including (1) enablement of large-scale analytics; (2) automation; (3) high accuracy; (4) sensitivity in detecting subtle changes; (5) tolerance of noise in data; and (6) rapid technological advancement. As GeoAI remains a rapidly evolving field, we also describe current knowledge gaps and discuss future research directions.  more » « less
Award ID(s):
1853864 2120943 2021147
PAR ID:
10343912
Author(s) / Creator(s):
;
Date Published:
Journal Name:
ISPRS International Journal of Geo-Information
Volume:
11
Issue:
7
ISSN:
2220-9964
Page Range / eLocation ID:
385
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Remote Sensing)
    null (Ed.)
    This paper introduces a new GeoAI solution to support automated mapping of global craters on the Mars surface. Traditional crater detection algorithms suffer from the limitation of working only in a semiautomated or multi-stage manner, and most were developed to handle a specific dataset in a small subarea of Mars’ surface, hindering their transferability for global crater detection. As an alternative, we propose a GeoAI solution based on deep learning to tackle this problem effectively. Three innovative features are integrated into our object detection pipeline: (1) a feature pyramid network is leveraged to generate feature maps with rich semantics across multiple object scales; (2) prior geospatial knowledge based on the Hough transform is integrated to enable more accurate localization of potential craters; and (3) a scale-aware classifier is adopted to increase the prediction accuracy of both large and small crater instances. The results show that the proposed strategies bring a significant increase in crater detection performance than the popular Faster R-CNN model. The integration of geospatial domain knowledge into the data-driven analytics moves GeoAI research up to the next level to enable knowledge-driven GeoAI. This research can be applied to a wide variety of object detection and image analysis tasks. 
    more » « less
  2. ; ; ; ; ; ; ; (, Urban Informatics)
    Abstract This study examines the role of human dynamics within Geospatial Artificial Intelligence (GeoAI), highlighting its potential to reshape the geospatial research field. GeoAI, emerging from the confluence of geospatial technologies and artificial intelligence, is revolutionizing our comprehension of human-environmental interactions. This revolution is powered by large-scale models trained on extensive geospatial datasets, employing deep learning to analyze complex geospatial phenomena. Our findings highlight the synergy between human intelligence and AI. Particularly, the humans-as-sensors approach enhances the accuracy of geospatial data analysis by leveraging human-centric AI, while the evolving GeoAI landscape underscores the significance of human–robot interaction and the customization of GeoAI services to meet individual needs. The concept of mixed-experts GeoAI, integrating human expertise with AI, plays a crucial role in conducting sophisticated data analyses, ensuring that human insights remain at the forefront of this field. This paper also tackles ethical issues such as privacy and bias, which are pivotal for the ethical application of GeoAI. By exploring these human-centric considerations, we discuss how the collaborations between humans and AI transform the future of work at the human-technology frontier and redefine the role of AI in geospatial contexts. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; (, AGILE: GIScience Series)
    Abstract. Driven by foundation models, recent progress in AI and machine learning has reached unprecedented complexity. For instance, the GPT-3 language model consists of 175 billion parameters and a training-data size of 570 GB. While it has achieved remarkable performance in generating text that is difficult to distinguish from human-authored content, a single training of the model is estimated to produce over 550 metric tons of CO2 emissions. Likewise, we see advances in GeoAI research improving large-scale prediction tasks like satellite image classification and global climate modeling, to name but a couple. While these models have not yet reached comparable complexity and emissions levels, spatio-temporal models differ from language and image-generation models in several ways that make it necessary to (re)train them more often, with potentially large implications for sustainability. While recent work in the machine learning community has started calling for greener and more energy-efficient AI alongside improvements in model accuracy, this trend has not yet reached the GeoAI community at large. In this work, we bring this issue to not only the attention of the GeoAI community but also present ethical considerations from a geographic perspective that are missing from the broader, ongoing AI-sustainability discussion. To start this discussion, we propose a framework to evaluate models from several sustainability-related angles, including energy efficiency, carbon intensity, transparency, and social implications. We encourage future AI/GeoAI work to acknowledge its environmental impact as a step towards a more resource-conscious society. Similar to the current push for reproducibility, future publications should also report the energy/carbon costs of improvements over prior work. 
    more » « less
  4. ; ; ; (, Inernational Conference on Machine Learning)
    Encoding geospatial objects is fundamental for geospatial artificial intelligence (GeoAI) applications, which leverage machine learning (ML) models to analyze spatial information. Common approaches transform each object into known formats, like image and text, for compatibility with ML models. However, this process often discards crucial spatial information, such as the object’s position relative to the entire space, reducing downstream task effectiveness. Alternative encoding methods that preserve some spatial properties are often devised for specific data objects (e.g., point encoders), making them unsuitable for tasks that involve different data types (i.e., points, polylines, and polygons). To this end, we propose POLY2VEC, a polymorphic Fourier-based encoding approach that unifies the representation of geospatial objects, while preserving the essential spatial properties. POLY2VEC incorporates a learned fusion module that adaptively integrates the magnitude and phase of the Fourier transform for different tasks and geometries. We evaluate POLY2VEC on five diverse tasks, organized into two categories. The first empirically demonstrates that POLY2VEC consistently outperforms objectspecific baselines in preserving three key spatial relationships: topology, direction, and distance. The second shows that integrating POLY2VEC into a state-of-the-art GeoAI workflow improves the performance in two popular tasks: population prediction and land use inference. 
    more » « less
  5. ; ; ; ; ; ; (, Journal of Spatial Information Science)
    This paper reviews trends in GeoAI research and discusses cutting-edge advances in GeoAI and its roles in accelerating environmental and social sciences. It addresses ongoing attempts to improve the predictability of GeoAI models and recent research aimed at increasing model explainability and reproducibility to ensure trustworthy geospatial findings. The paper also provides reflections on the importance of defining the science of GeoAI in terms of its fundamental principles, theories, and methods to ensure scientific rigor, social responsibility, and lasting impacts. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email