The density and complexity of urban environments
present significant challenges for autonomous vehicles. Moreover,
ensuring pedestrians’ safety and protecting personal privacy
are crucial considerations in these environments. Smart city
intersections and AI-powered traffic management systems will be
essential for addressing these challenges. Therefore, our research
focuses on creating an experimental framework for the design of
applications that support the secure and efficient management of
traffic intersections in urban areas. We integrated two cameras
(street-level and bird’s eye view), both viewing an intersection,
and a programmable edge computing node, deployed within the
COSMOS testbed in New York City, with a central management
platform provided by Kentyou. We designed a pipeline to collect
and analyze the video streams from both cameras and obtain
real-time traffic/pedestrian-related information to support smart
city applications. The obtained information from both cameras
is merged, and the results are sent to a dedicated dashboard
for real-time visualization and further assessment (e.g., accident
prevention). The process does not require sending the raw videos
in order to avoid violating pedestrians’ privacy. In this demo, we
present the designed video analytic pipelines and their integration
with Kentyou central management platform.
Index Terms—object detection and tracking, camera networks,
smart intersection, real-time visualization
more »
« less
Real-time camera analytics for enhancing traffic intersection safety
Crowded metropolises present unique challenges to the potential
deployment of autonomous vehicles. Safety of pedestrians cannot be
compromised and personal privacy must be preserved. Smart city intersections will be at the core of Artificial Intelligence (AI)-powered
citizen-friendly traffic management systems for such metropolises.
Hence, the main objective of this work is to develop an experimentation framework for designing applications in support of secure
and efficient traffic intersections in urban areas. We integrated a
camera and a programmable edge computing node, deployed within
the COSMOS testbed in New York City, with an Eclipse sensiNact
data platform provided by Kentyou. We use this pipeline to collect
and analyze video streams in real-time to support smart city applications. In this demo, we present a video analytics pipeline that
analyzes the video stream from a COSMOS’ street-level camera to
extract traffic/crowd-related information and sends it to a dedicated
dashboard for real-time visualization and further assessment. This
is done without sending the raw video, in order to avoid violating
pedestrians’ privacy.
more »
« less
- NSF-PAR ID:
- 10346910
- Date Published:
- Journal Name:
- in Proc. ACM MobiSys’22, 2022
- Page Range / eLocation ID:
- 630 to 631
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The density and complexity of urban environments present significant challenges for autonomous vehicles. Moreover, ensuring pedestrians’ safety and protecting personal privacy are crucial considerations in these environments. Smart city intersections and AI-powered traffic management systems will be essential for addressing these challenges. Therefore, our research focuses on creating an experimental framework for the design of applications that support the secure and efficient management of traffic intersections in urban areas. We integrated two cameras (street-level and bird’s eye view), both viewing an intersection, and a programmable edge computing node, deployed within the COSMOS testbed in New York City, with a central management platform provided by Kentyou. We designed a pipeline to collect and analyze the video streams from both cameras and obtain real-time traffic/pedestrian-related information to support smart city applications. The obtained information from both cameras is merged, and the results are sent to a dedicated dashboard for real-time visualization and further assessment (e.g., accident prevention). The process does not require sending the raw videos in order to avoid violating pedestrians’ privacy. In this demo, we present the designed video analytic pipelines and their integration with Kentyou central management platform.more » « less
-
Social distancing can reduce the infection rates in respiratory pandemics such as COVID-19. Traffic intersections are particularly suitable for monitoring and evaluation of social distancing behavior in metropolises. Hence, in this paper, we propose and evaluate a real-time privacy-preserving social distancing analysis system (B-SDA), which uses bird’s-eye view video recordings of pedestrians who cross traffic intersections. We devise algorithms for video pre-processing, object detection, and tracking which are rooted in the known computer-vision and deep learning techniques, but modified to address the problem of detecting very small objects/pedestrians captured by a highly elevated camera. We propose a method for incorporating pedestrian grouping for detection of social distancing violations, which achieves 0.92 F1 score. B-SDA is used to compare pedestrian behavior in pre-pandemic and during-pandemic videos in uptown Manhattan, showing that the social distancing violation rate of 15.6% during the pandemic is notably lower than 31.4% prepandemic baseline. Keywords—Social distancing, Object detection, Smart city, Testbedsmore » « less
-
Traffic intersections are the most suitable locations for the deployment of computing, communications, and intelligence services for smart cities of the future. The abundance of data to be collected and processed, in combination with privacy and security concerns, motivates the use of the edgecomputing paradigm which aligns well with physical intersections in metropolises. This paper focuses on high-bandwidth, lowlatency applications, and in that context it describes: (i) system design considerations for smart city intersection intelligence nodes; (ii) key technological components including sensors, networking, edge computing, low latency design, and AI-based intelligence; and (iii) applications such as privacy preservation, cloud-connected vehicles, a real-time ”radar-screen”, traffic management, and monitoring of pedestrian behavior during pandemics. The results of the experimental studies performed on the COSMOS testbed located in New York City are illustrated. Future challenges in designing human-centered smart city intersections are summarized.more » « less
-
Traffic intersections are the most suitable locations for the deployment of computing, communications, and intelligence services for smart cities of the future. The abundance of data to be collected and processed, in combination with privacy and security concerns, motivates the use of the edgecomputing paradigm which aligns well with physical intersections in metropolises. This paper focuses on high-bandwidth, lowlatency applications, and in that context it describes: (i) system design considerations for smart city intersection intelligence nodes; (ii) key technological components including sensors, networking, edge computing, low latency design, and AI-based intelligence; and (iii) applications such as privacy preservation, cloud-connected vehicles, a real-time ”radar-screen”, traffic management, and monitoring of pedestrian behavior during pandemics. The results of the experimental studies performed on the COSMOS testbed located in New York City are illustrated. Future challenges in designing human-centered smart city intersections are summarized.more » « less