An official website of the United States government
Monitoring systems have hundreds or thousands of distributed sensors gathering and transmitting real-time streaming data. The early detection of events in these systems, such as an earthquake in a seismic monitoring system, is the base for essential tasks as warning generations. To detect such events is usual to compute pairwise correlation across the disparate signals generated by the sensors. Since the data sources (e.g., sensors) are spatially separated, it is essential to consider the lagged correlation between the signals. Besides, many applications require to process a specific band of frequencies depending on the event’s type, demanding a pre-processing step of filtering before computing correlations. Due to the high speed of data generation and a large number of sensors in these systems, the operations of filtering and lagged cross-correlation need to be efficient to provide real-time responses without data losses. This article proposes a technique named FilCorr that efficiently computes both operations in one single step. We achieve an order of magnitude speedup by maintaining frequency transforms over sliding windows. Our method is exact, devoid of sensitive parameters, and easily parallelizable. Besides our algorithm, we also provide a publicly available real-time system named Seisviz that employs FilCorr in its core mechanism for monitoring a seismometer network. We demonstrate that our technique is suitable for several monitoring applications as seismic signal monitoring, motion monitoring, and neural activity monitoring.
more »
« less
FilCorr: Filtered and Lagged Correlation on Streaming Time Series
An essential task on streaming time series data is to compute pairwise correlation across disparate signal sources to identify significant events. In many monitoring applications, such as geospatial monitoring, motion monitoring and critical infrastructure monitoring, correlation is observed at various frequency bands and temporal lags. In this paper, we consider computing filtered and lagged correlation on streaming time series data, which is challenging because the computation must be “in-sync” with the incoming stream for any detected events to be useful. We propose a technique to compute filtered and lagged correlation on streaming data efficiently by merging two individual operations: filtering and cross-correlations. We achieve an order of magnitude speed-up by maintaining frequency transforms over sliding windows. Our method is exact, devoid of sensitive parameters, and easily parallelizable. We demonstrate our technique in a seismic signal monitoring application.
more »
« less
- Award ID(s):
- 1757207
- PAR ID:
- 10230402
- Date Published:
- Journal Name:
- 2020 IEEE International Conference on Data Mining (ICDM)
- Page Range / eLocation ID:
- 1436 to 1441
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Lahars, or volcanic mudflows, are one of the most devastating natural, volcanic hazards. Deadly lahars, such as the one that occurred after the Nevado del Ruiz, Columbia eruption in 1985, in which at least 23,000 people tragically lost their lives, threaten the safety and well-being of humans, the economy, and the infrastructure of many of the communities living in the vicinity of volcanoes. Due to their complex flow behaviors, lahars remain a major challenge to those studying them. We present an analysis of several rain-triggered lahar events at Volcán Fuego in Guatemala using both seismic and infrasound monitoring to quantify both ground vibrations and low-frequency atmospheric sound waves associated with these mudflows. Geophysical data collected over this field campaign quantifies flow parameters such as velocities, stage and the frequency of these rain-triggered lahars. Time-lapse imagery of lahar flows is compared with filtered seismo-acoustic signal characteristics to ascertain stage predictions and relationship to stage fluxes. Using random forest regression models, we establish moderate correlations (correlation coefficient modes 0.48–0.53) with statistical significance (pvalue = 0.01–0.02) between signal energetics and respective stage. Compiling a catalog of rain-triggered lahar events in Volcán de Fuego’s drainages over a season permits a dataset amenable to statistical analysis. Our goal is the development of new-generation geophysical monitoring tools that will be capable of remote and real-time estimation of flow parameters.more » « less
-
Bertrand, N.; null (Ed.)In this paper, we consider the problem of monitoring temporal patterns expressed in Signal Temporal Logic (STL) over time-series data in a clairvoyant fashion. Existing offline or online monitoring algorithms can only compute the satisfaction of a given STL formula on the time-series data that is available. We use off-the-shelf statistical time-series analysis techniques to fit available data to a model and use this model to forecast future signal values. We derive the joint probability distribution of predicted signal values and use this to compute the satisfaction probability of a given signal pattern over the prediction horizon. There are numerous potential applications of such prescient detection of temporal patterns. We demonstrate practicality of our approach on case studies in automated insulin delivery, unmanned aerial vehicles, and household power consumption data.more » « less
-
Abstract High-dimensional quantum entanglement is a cornerstone for advanced technology enabling large-scale noise-tolerant quantum systems, fault-tolerant quantum computing, and distributed quantum networks. The recently developed biphoton frequency comb (BFC) provides a powerful platform for high-dimensional quantum information processing in its spectral and temporal quantum modes. Here we propose and generate a singly-filtered high-dimensional BFC via spontaneous parametric down-conversion by spectrally shaping only the signal photons with a Fabry-Pérot cavity. High-dimensional energy-time entanglement is verified through Franson-interference recurrences and temporal correlation with low-jitter detectors. Frequency- and temporal- entanglement of our singly-filtered BFC is then quantified by Schmidt mode decomposition. Subsequently, we distribute the high-dimensional singly-filtered BFC state over a 10 km fiber link with a post-distribution time-bin dimension lower bounded to be at least 168. Our demonstrations of high-dimensional entanglement and entanglement distribution show the singly-filtered quantum frequency comb’s capability for high-efficiency quantum information processing and high-capacity quantum networks.more » « less
-
Abstract We study the problem of drift estimation for two-scale continuous time series. We set ourselves in the framework of overdamped Langevin equations, for which a single-scale surrogate homogenized equation exists. In this setting, estimating the drift coefficient of the homogenized equation requires pre-processing of the data, often in the form of subsampling; this is because the two-scale equation and the homogenized single-scale equation are incompatible at small scales, generating mutually singular measures on the path space. We avoid subsampling and work instead with filtered data, found by application of an appropriate kernel function, and compute maximum likelihood estimators based on the filtered process. We show that the estimators we propose are asymptotically unbiased and demonstrate numerically the advantages of our method with respect to subsampling. Finally, we show how our filtered data methodology can be combined with Bayesian techniques and provide a full uncertainty quantification of the inference procedure.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/icdm50108.2020.00190
