An official website of the United States government
Access to high-quality data is an important barrier in the digital analysis of urban settings, including applications within computer vision and urban design. Diverse forms of data collected from sensors in areas of high activity in the urban environment, particularly at street intersections, are valuable resources for researchers interpreting the dynamics between vehicles, pedestrians, and the built environment. In this paper, we present a high-resolution audio, video, and LiDAR dataset of three urban intersections in Brooklyn, New York, totaling almost 8 unique hours. The data were collected with custom Reconfigurable Environmental Intelligence Platform (REIP) sensors that were designed with the ability to accurately synchronize multiple video and audio inputs. The resulting data are novel in that they are inclusively multimodal, multi-angular, high-resolution, and synchronized. We demonstrate four ways the data could be utilized — (1) to discover and locate occluded objects using multiple sensors and modalities, (2) to associate audio events with their respective visual representations using both video and audio modes, (3) to track the amount of each type of object in a scene over time, and (4) to measure pedestrian speed using multiple synchronized camera views. In addition to these use cases, our data are available for other researchers to carry out analyses related to applying machine learning to understanding the urban environment (in which existing datasets may be inadequate), such as pedestrian-vehicle interaction modeling and pedestrian attribute recognition. Such analyses can help inform decisions made in the context of urban sensing and smart cities, including accessibility-aware urban design and Vision Zero initiatives.
more »
« less
Understanding pedestrian movement using urban sensing technologies: the promise of audio-based sensors
Abstract While various sensors have been deployed to monitor vehicular flows, sensing pedestrian movement is still nascent. Yet walking is a significant mode of travel in many cities, especially those in Europe, Africa, and Asia. Understanding pedestrian volumes and flows is essential for designing safer and more attractive pedestrian infrastructure and for controlling periodic overcrowding. This study discusses a new approach to scale up urban sensing of people with the help of novel audio-based technology. It assesses the benefits and limitations of microphone-based sensors as compared to other forms of pedestrian sensing. A large-scale dataset called ASPED is presented, which includes high-quality audio recordings along with video recordings used for labeling the pedestrian count data. The baseline analyses highlight the promise of using audio sensors for pedestrian tracking, although algorithmic and technological improvements to make the sensors practically usable continue. This study also demonstrates how the data can be leveraged to predict pedestrian trajectories. Finally, it discusses the use cases and scenarios where audio-based pedestrian sensing can support better urban and transportation planning.
more »
« less
- Award ID(s):
- 2203408
- PAR ID:
- 10522482
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- Urban Informatics
- Volume:
- 3
- Issue:
- 1
- ISSN:
- 2731-6963
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The detection and counting of pedestrians plays a central role for the design of smart cities. Although the use of cameras for this task has been shown to have high accuracy, they come at a high cost and are susceptible to challenges such as poor lighting, fog, and obstructed views. Our study investigates audio-based pedestrian detection, combining potentially low cost sensors with advanced machine learning based audio analysis algorithms. With an audio sensor installed along the walkway, machine learning algorithms can tell from the audio whether there is a pedestrian or not, or how far the pedestrian is from the sensor. Results show the general feasibility of audio-based pedestrian detection but fall short of reaching the accuracy levels of video-based detection.more » « less
-
Urban environments pose significant challenges to pedestrian safety and mobility. This paper introduces a novel modular sensing framework for developing real-time, multimodal streetscape applications in smart cities. Prior urban sensing systems predominantly rely either on fixed data modalities or centralized data processing, resulting in limited flexibility, high latency, and superficial privacy protections. In contrast, our framework integrates diverse sensing modalities, including cameras, mobile IMU sensors, and wearables into a unified ecosystem leveraging edge-driven distributed analytics. The proposed modular architecture, supported by standardized APIs and message-driven communication, enables hyper-local sensing and scalable development of responsive pedestrian applications. A concrete application demonstrating multimodal pedestrian tracking is developed and evaluated. It is based on the cross-modal inference module, which fuses visual and mobile IMU sensor data to associate detected entities in the camera domain with their corresponding mobile device.We evaluate our framework’s performance in various urban sensing scenarios, demonstrating an online association accuracy of 75% with a latency of ≈39 milliseconds. Our results demonstrate significant potential for broader pedestrian safety and mobility scenarios in smart cities.more » « less
-
ABSTRACT Distributed acoustic sensing (DAS) technology is an emerging field of seismic sensing that enables recording ambient noise seismic data along the entire length of a fiber-optic cable at meter-scale resolution. Such a dense spatial resolution of recordings over long distances has not been possible using traditional methods because of limited hardware resources and logistical concerns in an urban environment. The low spatial resolution of traditional passive seismic acquisition techniques has limited the accuracy of the previously generated velocity profiles in many important urban regions, including the Reno-area basin, to the top 100 m of the underlying subsurface. Applying the method of seismic interferometry to ambient noise strain rate data obtained from a dark-fiber cable allows for generating noise cross correlations, which can be used to infer shallow and deep subsurface properties and basin geometry. We gathered DAS ambient noise seismic data for this study using a 12 km portion of a dark-fiber line in Reno, Nevada. We used gathered data to generate and invert dispersion curves to estimate the near-surface shear-wave velocity structure. Comparing the generated velocity profiles with previous regional studies shows good agreement in determining the average depth to bedrock and velocity variations in the analyzed domain. A synthetic experiment is also performed to verify the proposed framework further and better understand the effect of the infrastructural cover along the cable. The results obtained from this research provide insight into the application of DAS using dark-fiber lines in subsurface characterization in urban environments. It also discusses the potential effects of the conduit that covers such permanent fiber installations on the produced inversion results.more » « less
-
This study investigates the relationship between urban walkability and human stress across three distinct sites, utilizing data collected from wearable sensors. The objective is to assess how urban design and environmental factors influence human stress while walking. Participants were equipped with wearable sensors to monitor physiological indicators of stress (e.g., heart rate variability, etc.) as they walked through different urban environments. Data was collected in realtime to capture fluctuations in stress levels and provide insights into how specific urban design features impact pedestrian well-being. To facilitate data collection and analysis, walking areas were divided into blocks, and urban design features were grouped into six categories such as imageability, enclosure, human scale, transparency, complexity, and safety. Each city has different features, depending on the issues that were considered most pressing for that city. To supplement sensor stress data, the study also utilized surveys to gather participants’ perceptions of safety, comfort, and environmental quality. Using regression analysis, researchers identified the urban design categories that have a significant impact on stress scores and their frequency. Machine learning models were built to predict stress scores based on the urban design aspects and air quality data as input features. Results showed that increased stress is correlated with poorly designed walkways, while lower stress was linked to well-maintained paths and green spaces. Transparency and enclosure were identified as significant contributors to pedestrian stress. The findings from one of the three cities add another dimension to the understanding of walkability and stress, highlighting that there are factors beyond basic infrastructure, such as noise levels and tree canopy can play a significant role in influencing pedestrian well-being. Findings from this research can facilitate targeted infrastructure planning and investment, better mobility, and ultimately improve the quality of life in urban areas. Future research should consider a wider range of environmental and social factors and how different factors interact over time to influence stress levels.more » « less
