skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Open-source data pipeline for street-view images: A case study on community mobility during COVID-19 pandemic
Street View Images (SVI) are a common source of valuable data for researchers. Researchers have used SVI data for estimating pedestrian volumes, demographic surveillance, and to better understand built and natural environments in cityscapes. However, the most common source of publicly available SVI data is Google Street View. Google Street View images are collected infrequently, making temporal analysis challenging, especially in low population density areas. Our main contribution is the development of an open-source data pipeline for processing 360-degree video recorded from a car-mounted camera. The video data is used to generate SVIs, which then can be used as an input for longitudinal analysis. We demonstrate the use of the pipeline by collecting an SVI dataset over a 38-month longitudinal survey of Seattle, WA, USA during the COVID-19 pandemic. The output of our pipeline is validated through statistical analyses of pedestrian traffic in the images. We confirm known results in the literature and provide new insights into outdoor pedestrian traffic patterns. This study demonstrates the feasibility and value of collecting and using SVI for research purposes beyond what is possible with currently available SVI data. Our methods and dataset represent a first of its kind longitudinal collection and application of SVI data for research purposes. Limitations and future improvements to the data pipeline and case study are also discussed.  more » « less
Award ID(s):
2031119
PAR ID:
10528224
Author(s) / Creator(s):
; ; ; ; ; ; ;
Editor(s):
Mosa, Ahmed Mancy
Publisher / Repository:
PLOS
Date Published:
Journal Name:
PLOS ONE
Volume:
19
Issue:
5
ISSN:
1932-6203
Page Range / eLocation ID:
e0303180
Subject(s) / Keyword(s):
Street view imaging
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, 2023 9th International Conference on Control, Automation and Robotics (ICCAR))
    “Data is the new oil” has become a popular catch-phrase in the world of technology, emphasizing the immense value of data in today's digital age. Most services and platforms rely on data, but collecting this data can be challenging and costly. To address this issue, we leverage a novel distributed crowdsourcing framework - termed Swarm Contracts - that utilizes blockchain and is applied to robotics technologies. The framework encourages an incentivized crowdsourcing model through open-source robots and a secure, decentralized, and transparent blockchain-based incentive system. As a demonstration of the framework's capabilities, we use it to collect Google Street View ® map data, which can be a resource-intensive task to keep up to date using traditional centralized methods. Our Swarm Contract framework uses Google Street View ® Publish API, which allows for the contribution of street view data to Google Maps @to implement the incentive-based crowdsourcing of street view images. By incorporating a swarm contract-powered framework with the Google Street View ® Publish API, we show that the incentivized crowdsourcing of street view data can be a practical solution to maintain accurate and up-to-date Google Street View ® maps. 
    more » « less
  2. (, in Proc. IEEE MASS’22 (invited), Oct. 2022)
    Video cameras in smart cities can be used to provide data to improve pedestrian safety and traffic management. Video recordings inherently violate privacy, and technological solutions need to be found to preserve it. Smart city applications deployed on top of the COSMOS research testbed in New York City are envisioned to be privacy friendly. This contribution presents one approach to privacy preservation – a video anonymization pipeline implemented in the form of blurring of pedestrian faces and vehicle license plates. The pipeline utilizes customized deeplearning models based on YOLOv4 for detection of privacysensitive objects in street-level video recordings. To achieve real time inference, the pipeline includes speed improvements via NVIDIA TensorRT optimization. When applied to the video dataset acquired at an intersection within the COSMOS testbed in New York City, the proposed method anonymizes visible faces and license plates with recall of up to 99% and inference speed faster than 100 frames per second. The results of a comprehensive evaluation study are presented. A selection of anonymized videos can be accessed via the COSMOS testbed portal. 
    more » « less
  3. (, in Proc. IEEE MASS’22 (invited), 2022 (invited))
    Video cameras in smart cities can be used to provide data to improve pedestrian safety and traffic management. Video recordings inherently violate privacy, and technological solutions need to be found to preserve it. Smart city applications deployed on top of the COSMOS research testbed in New York City are envisioned to be privacy friendly. This contribution presents one approach to privacy preservation– a video anonymization pipeline implemented in the form of blurring of pedestrian faces and vehicle license plates. The pipeline utilizes customized deeplearning models based on YOLOv4 for detection of privacysensitive objects in street-level video recordings. To achieve real time inference, the pipeline includes speed improvements via NVIDIA TensorRT optimization. When applied to the video dataset acquired at an intersection within the COSMOS testbed in New York City, the proposed method anonymizes visible faces and license plates with recall of up to 99% and inference speed faster than 100 frames per second. The results of a comprehensive evaluation study are presented. A selection of anonymized videos can be accessed via the COSMOS testbed portal. Index Terms—Smart City, Sensors, Video Surveillance, Privacy Protection, Object Detection, Deep Learning, TensorRT. 
    more » « less
  4. (, in Proc. IEEE MASS’22 (invited), 2022.)
    Video cameras in smart cities can be used to provide data to improve pedestrian safety and traffic management. Video recordings inherently violate privacy, and technological solutions need to be found to preserve it. Smart city applications deployed on top of the COSMOS research testbed in New York City are envisioned to be privacy friendly. This contribution presents one approach to privacy preservation – a video anonymization pipeline implemented in the form of blurring of pedestrian faces and vehicle license plates. The pipeline utilizes customized deeplearning models based on YOLOv4 for detection of privacysensitive objects in street-level video recordings. To achieve real time inference, the pipeline includes speed improvements via NVIDIA TensorRT optimization. When applied to the video dataset acquired at an intersection within the COSMOS testbed in New York City, the proposed method anonymizes visible faces and license plates with recall of up to 99% and inference speed faster than 100 frames per second. The results of a comprehensive evaluation study are presented. A selection of anonymized videos can be accessed via the COSMOS testbed portal. Index Terms—Smart City, Sensors, Video Surveillance, Privacy Protection, Object Detection, Deep Learning, TensorRT. 
    more » « less
  5. ; ; ; ; ; (, Urban Science)
    Data on pedestrian infrastructure is essential for improving the mobility environment and for planning efficiency. Although governmental agencies are responsible for capturing data on pedestrian infrastructure mostly by field audits, most have not completed such audits. In recent years, virtual auditing based on street view imagery (SVI), specifically through geo-crowdsourcing platforms, offers a more inclusive approach to pedestrian movement planning, but concerns about the quality and reliability of opensource geospatial data pose barriers to use by governments. Limited research has compared opensource data in relation to traditional government approaches. In this study, we compare pedestrian infrastructure data from an opensource virtual sidewalk audit platform (Project Sidewalk) with government data. We focus on neighborhoods with diverse walkability and income levels in the city of Seattle, Washington and in DuPage County, Illinois. Our analysis shows that Project Sidewalk data can be a reliable alternative to government data for most pedestrian infrastructure features. The agreement for different features ranges from 75% for pedestrian signals to complete agreement (100%) for missing sidewalks. However, variations in measuring the severity of barriers challenges dataset comparisons. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email