skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Training Computers to See the Built Environment Related to Physical Activity: Detection of Microscale Walkability Features Using Computer Vision
The study purpose was to train and validate a deep learning approach to detect microscale streetscape features related to pedestrian physical activity. This work innovates by combining computer vision techniques with Google Street View (GSV) images to overcome impediments to conducting audits (e.g., time, safety, and expert labor cost). The EfficientNETB5 architecture was used to build deep learning models for eight microscale features guided by the Microscale Audit of Pedestrian Streetscapes Mini tool: sidewalks, sidewalk buffers, curb cuts, zebra and line crosswalks, walk signals, bike symbols, and streetlights. We used a train–correct loop, whereby images were trained on a training dataset, evaluated using a separate validation dataset, and trained further until acceptable performance metrics were achieved. Further, we used trained models to audit participant (N = 512) neighborhoods in the WalkIT Arizona trial. Correlations were explored between microscale features and GIS-measured and participant-reported neighborhood macroscale walkability. Classifier precision, recall, and overall accuracy were all over >84%. Total microscale was associated with overall macroscale walkability (r = 0.30, p < 0.001). Positive associations were found between model-detected and self-reported sidewalks (r = 0.41, p < 0.001) and sidewalk buffers (r = 0.26, p < 0.001). The computer vision model results suggest an alternative to trained human raters, allowing for audits of hundreds or thousands of neighborhoods for population surveillance or hypothesis testing.  more » « less
Award ID(s):
1942805
PAR ID:
10328206
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
International Journal of Environmental Research and Public Health
Volume:
19
Issue:
8
ISSN:
1660-4601
Page Range / eLocation ID:
4548
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Data on pedestrian infrastructure is essential for improving the mobility environment and for planning efficiency. Although governmental agencies are responsible for capturing data on pedestrian infrastructure mostly by field audits, most have not completed such audits. In recent years, virtual auditing based on street view imagery (SVI), specifically through geo-crowdsourcing platforms, offers a more inclusive approach to pedestrian movement planning, but concerns about the quality and reliability of opensource geospatial data pose barriers to use by governments. Limited research has compared opensource data in relation to traditional government approaches. In this study, we compare pedestrian infrastructure data from an opensource virtual sidewalk audit platform (Project Sidewalk) with government data. We focus on neighborhoods with diverse walkability and income levels in the city of Seattle, Washington and in DuPage County, Illinois. Our analysis shows that Project Sidewalk data can be a reliable alternative to government data for most pedestrian infrastructure features. The agreement for different features ranges from 75% for pedestrian signals to complete agreement (100%) for missing sidewalks. However, variations in measuring the severity of barriers challenges dataset comparisons. 
    more » « less
  2. With the rise of global temperature, many cities are suffering from more and more frequent extreme heat in hot summers. Quantitative information on the spatial distributions of urban heat has become more and more important for extreme heat mitigation and adaptation in cities. This study first investigated the fine-level heat hazard distributions at the sidewalk and building block level from the pedestrian perspective in Philadelphia, Pennsylvania. The urban microclimate modeling based on a high-resolution urban geometrical model was used to generate the 1m resolution outdoor heat hazard map in the study area. The sidewalk map was overlaid on the generated high-resolution heat hazard map to estimate the sidewalk level heat hazard. Based on the sidewalk level heat hazard map, this study further calculated the heat hazard level in the 400m walkshed along sidewalks for each building block. The building level hazard data were then aggregated at the census tract level to compare with the socioeconomic and racial/ethnic variables. The result shows that neighborhoods with higher proportion of African Americans have a higher heat hazard level in Philadelphia. This study would provide new insights for developing more thermally comfortable and pedestrian-friendly neighborhoods in the context of climate change. 
    more » « less
  3. While cities around the world are increasingly promoting streets and public spaces that prioritize pedestrians over vehicles, significant data gaps have made pedestrian mapping, analysis, and modeling challenging to carry out. Most cities, even in industrialized economies, still lack information about the location and connectivity of their sidewalks, making it difficult to implement research on pedestrian infrastructure and holding the technology industry back from developing accurate, location-based Apps for pedestrians, wheelchair users, street vendors, and other sidewalk users. To address this gap, we have designed and implemented an end-to-end open-source tool— Tile2Net —for extracting sidewalk, crosswalk, and footpath polygons from orthorectified aerial imagery using semantic segmentation. The segmentation model, trained on aerial imagery from Cambridge, MA, Washington DC, and New York City, offers the first open-source scene classification model for pedestrian infrastructure from sub-meter resolution aerial tiles, which can be used to generate planimetric sidewalk data in North American cities. Tile2Net also generates pedestrian networks from the resulting polygons, which can be used to prepare datasets for pedestrian routing applications. The work offers a low-cost and scalable data collection methodology for systematically generating sidewalk network datasets, where orthorectified aerial imagery is available, contributing to over-due efforts to equalize data opportunities for pedestrians, particularly in cities that lack the resources necessary to collect such data using more conventional methods. 
    more » « less
  4. null (Ed.)
    As paper ballots and post-election audits gain increased adoption in the United States, election technology vendors are offering products that allow jurisdictions to review ballot images—digital scans produced by optical-scan voting machines—in their post-election audit procedures. Jurisdictions including the state of Maryland rely on such image audits as an alternative to inspecting the physical paper ballots. We show that image audits can be reliably defeated by an attacker who can run malicious code on the voting machines or election management system. Using computer vision techniques, we develop an algorithm that automatically and seamlessly manipulates ballot images, moving voters’ marks so that they appear to be votes for the attacker’s preferred candidate. Our implementation is compatible with many widely used ballot styles, and we show that it is effective using a large corpus of ballot images from a real election. We also show that the attack can be delivered in the form of a malicious Windows scanner driver, which we test with a scanner that has been certified for use in vote tabulation by the U.S. Election Assistance Commission. These results demonstrate that post-election audits must inspect physical ballots, not merely ballot images, if they are to strongly defend against computer-based attacks on widely used voting systems. 
    more » « less
  5. Outdoor heat stress is a growing problem in cities during hot weather. City planners and designers require more pedestrian-centered approaches to understand sidewalk microclimates. Radiation loading, as quantified by mean radiant temperature (TMRT), is a key factor driving poor thermal comfort. Street trees provide shade and consequently reduce pedestrian TMRT. However, placement of trees to optimize the cooling they provide is not yet well understood. We apply the newly-developed TUF-Pedestrian model to quantify the impacts of sidewalk tree coverage on pedestrian TMRT during summer for a lowrise neighbourhood in a midlatitude city. TUF-Pedestrian captures the detailed spatio-temporal variation of direct shading and directional longwave radiation loading on pedestrians resulting from tree shade. We conduct 190 multi-day simulations to assess a full range of sidewalk street tree coverages for five high heat exposure locations across four street orientations. We identify street directions that exhibit the largest TMRT reductions during the hottest periods of the day as a result of tree planting. Importantly, planting a shade tree on a street where none currently exist provides approximately 1.5–2 times as much radiative cooling to pedestrians as planting the same tree on a street where most of the sidewalk already benefits from tree shade. Thus, a relatively equal distribution of trees among sun-exposed pedestrian routes and sidewalks within a block or neighbourhood avoids mutual shading and therefore optimizes outdoor radiative heat reduction per tree during warm conditions. Ultimately, street tree planting should be a place-based decision and account for additional environmental and socio-political factors. 
    more » « less