skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: FiberFlex: Real-time FPGA-based Intelligent and Distributed Fiber Sensor System for Pedestrian Recognition
In recent years, security monitoring of public places and critical infrastructure has heavily relied on the widespread use of cameras, raising concerns about personal privacy violations. To balance the need for effective security monitoring with the protection of personal privacy, we explore the potential of optical fiber sensors for this application. This article proposes FiberFlex, an intelligent and distributed fiber sensor system. Ultizing Field Programmable Gate Arrays (FPGA) high-level synthesis (HLS) acceleration, FiberFlex offers real-time pedestrian detection by co-designing the entire pipeline of optical signal acquisition, processing, and recognition networks based on the principles of optical fiber sensing. As a promising alternative to traditional camera-based monitoring systems, FiberFlex achieves pedestrian detection by analyzing the vibration patterns caused by pedestrian footsteps, enabling security monitoring while preserving individual privacy. FiberFlex comprises three modules:First, fiber-optic sensing system: A fiber-optic distributed acoustic sensing (DAS) system is built and used to measure the ground vibration waves generated by people walking.Second, algorithms: We first collect the training data by measuring the ground vibration waves, label the data, and use the data to train the neural network models to perform pedestrian recognition.Third, hardware accelerators: We use HLS tools to design hardware modules on FPGA for data collection and pre-processing and integrate them with the downstream neural network accelerators to perform in-line real-time pedestrian detection. The final detection results are sent back from FPGA to the host CPU. We implement our system FiberFlex with the in-house built DAS system and AMD/Xilinx Kintex7 FPGA KC705 board and verify the whole system using the real-world collected data. We conduct recognition tests on five test subjects of varying ages, heights, and weights in a fixed sensing area. Each subject experienced 20 real-time recognition tests using their daily walking habits, and the subjects were given adequate rest between tests. After 100 tests on five test subjects, the overall real-time recognition accuracy exceeded\(88.0\%\). The whole system uses 55 W of power, 33 W in the optical DAS system and 22 W in the FPGA. Relying on its end-to-end interdisciplinary design, FiberFlex seamlessly combines fiber-optic sensors with FPGA accelerators to enable low-power real-time security monitoring without compromising privacy, making it a valuable addition to the existing security monitoring network. According to FiberFlex, more valuable research can be conducted in the future, such as fall monitoring for the elderly, migration of identification networks between different application scenarios, and improvement of anti-interference performance in more complex environments. In future perception networks, where the “eyes” are not feasible, let’s use fiber optic touch instead.  more » « less
Award ID(s):
2328972 2324864 2213701 2217003
PAR ID:
10605125
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  ;  ;  
Publisher / Repository:
Association for Computing Machinery (ACM)
Date Published:
Journal Name:
ACM Transactions on Reconfigurable Technology and Systems
Volume:
17
Issue:
4
ISSN:
1936-7406
Format(s):
Medium: X Size: p. 1-30
Size(s):
p. 1-30
Sponsoring Org:
National Science Foundation
More Like this
  1. Continuous monitoring of volcanic gas emissions is crucial for understanding volcanic activity and potential eruptions. However, emissions of volcanic gases underwater are infrequently studied or quantified. This study explores the potential of Distributed Acoustic Sensing (DAS) technology to monitor underwater volcanic degassing. DAS converts fiber-optic cables into high-resolution vibration recording arrays, providing measurements at unprecedented spatio-temporal resolution. We conducted an experiment at Laacher See volcano in Germany, immersing a fiber-optic cable in the lake and interrogating it with a DAS system. We detected and analyzed numerous acoustic signals that we associated with bubble emissions in different lake areas. Three types of text-book bubbles exhibiting characteristic waveforms are all found from our detections, indicating different nucleation processes and bubble sizes. Using clustering algorithms, we classified bubble events into four distinct clusters based on their temporal and spectral characteristics. The temporal distribution of the events provided insights into the evolution of gas seepage patterns. This technology has the potential to revolutionize underwater degassing monitoring and provide valuable information for studying volcanic processes and estimating gas emissions. Furthermore, DAS can be applied to other applications, such as monitoring underwater carbon capture and storage operations or methane leaks associated with climate change. 
    more » « less
  2. Abstract Distributed acoustic sensing (DAS) on submarine fiber-optic cables is providing new observational insights into solid Earth processes and ocean dynamics. However, the availability of offshore dark fibers for long-term deployment remains limited. Simultaneous telecommunication and DAS operating at different wavelengths in the same fiber, termed optical multiplexing, offers one solution. In May 2024, we collected a four-day DAS dataset utilizing an L-band DAS interrogator and multiplexing on the submarine cables of the Ocean Observatory Initiative’s Regional Cabled Array offshore central Oregon. Our findings show that multiplexed DAS has no impact on communications and is unaffected by network traffic. Moreover, the quality of DAS data collected via multiplexing matches that of data obtained from dark fiber. With a machine-learning event detection workflow, we detect 31 T waves and the S wave of one regional earthquake, demonstrating the feasibility of continuous earthquake monitoring using the multiplexed offshore DAS. We also examine ocean waves and ocean-generated seismic noise. We note high-frequency seismic noise modulated by low-frequency ocean swell and hypothesize about its origins. The complete dataset is freely available. 
    more » « less
  3. Seismic imaging and monitoring of the near-surface structure are crucial for the sustainable development of urban areas. However, standard seismic surveys based on cabled or autonomous geophone arrays are expensive and hard to adapt to noisy metropolitan environments. Distributed acoustic sensing (DAS) with pre-existing telecom fiber optic cables, together with seismic ambient noise interferometry, have the potential to fulfill this gap. However, a detailed noise wavefield characterization is needed before retrievingcoherent waves from chaotic noise sources. We analyze local seismic ambient noise by tracking five-month changes in signal-to-noise ratio (SNR) of Rayleigh surface wave estimated from traffic noise recorded by DAS along the straight university campus busy road. We apply the seismic interferometry method to the 800 m long part of the Penn State Fiber-Optic For Environment Sensing (FORESEE) array. We evaluate the 160 virtual shot gathers (VSGs) by determining the SNR using the slant-stack technique. We observe strong SNR variations in time and space. We notice higher SNR for virtual source points close to road obstacles. The spatial noise distribution confirms that noise energy focuses mainly on bumps and utility holes. We also see the destructive impact of precipitation, pedestrian traffic, and traffic along main intersections on VSGs. A similar processing workflow can be applied to various straight roadside fiber optic arrays in metropolitan areas. 
    more » « less
  4. Abstract There is growing interest in floating offshore wind turbine (FOWT) technology, where turbines are installed on floating structures anchored to the seabed, allowing wind energy development in areas unsuitable for traditional fixed-platform turbines. Responsible development requires monitoring the impact of FOWTs on marine wildlife, such as whales, throughout the operational lifecycle of the turbines. Distributed acoustic sensing (DAS)—a technology that transforms fiber-optic cables into vibration sensor arrays—has been demonstrated for acoustic monitoring of whales using seafloor telecommunications cables. However, no studies have yet evaluated DAS performance in dynamic, engineered environments, such as floating platforms or moving vessels with complex, dynamic strain loads, despite their relevance to FOWT settings. This study addresses that gap by deploying DAS aboard a boat in Monterey Bay, California, where a fiber-optic cable was lowered using a weighted and suspended mooring line, enabling vertical deployment. Humpback whale vocalizations were captured and identified in the DAS data, noise sources were identified, and DAS data were compared to audio captured by a standalone hydrophone attached to the mooring line and a nearby hydrophone on a cabled observatory. This study is unique in: (1) deploying DAS in a vertical deployment mode, where noise from turbulence, cable vibrations, and other sources posed additional challenges compared to seafloor DAS applications; (2) demonstrating DAS in a dynamic, nonstationary setup, which is uncommon for DAS interrogators typically used in more stable environments; and (3) leveraging looped sections of the cable to reduce the noise floor and mitigate the effects of excessive cable vibrations and strain. This research demonstrates DAS’s ability to capture whale vocalizations in challenging environments, highlighting its potential to enhance underwater acoustic monitoring, particularly in the context of renewable energy development in offshore environments. 
    more » « less
  5. The longwall mining method is designed to optimize coal extraction through controlled roof caving, which inevitably induces seismicity. This research employs a distributed acoustic sensing (DAS) system incorporating a fire-safe fiber-optic cable strategically installed underground within an operational longwall coal mine. Despite lower sensitivity than traditional seismometers, DAS sensing technology benefits from dense sensor spacing and close proximity to the active face, where many microseismic events occur. To automatically detect seismic events within the voluminous DAS data records, we employ convolutional autoencoder deep learning models that can be used for anomaly (potential seismic event) detection in power spectral density (PSD) images of DAS recordings. The kernel density estimation (KDE) technique is used to calculate the probability density function (PDF) for the density scores of the latent space (representation of compressed data). We then use this calculated parameter as a threshold to distinguish between the PSD associated with background noise and with potential seismic events. The DAS monitoring system in conjunction with the developed deep learning model could enhance longwall coal mining safety and efficiency by offering valuable data from its densely deployed multichannel sensors near mining operations. 
    more » « less