An official website of the United States government
Change point detection is widely used for finding transitions between states of data generation within a time series. Methods for change point detection currently assume this transition is instantaneous and therefore focus on finding a single point of data to classify as a change point. However, this assumption is flawed because many time series actually display short periods of transitions between different states of data generation. Previous work has shown Bayesian Online Change Point Detection (BOCPD) to be the most effective method for change point detection on a wide range of different time series. This paper explores adapting the change point detection algorithms to detect abrupt changes over short periods of time. We design a segment-based mechanism to examine a window of data points within a time series, rather than a single data point, to determine if the window captures abrupt change. We test our segment-based Bayesian change detection algorithm on 36 different time series and compare it to the original BOCPD algorithm. Our results show that, for some of these 36 time series, the segment-based approach for detecting abrupt changes can much more accurately identify change points based on standard metrics.
more »
« less
Change-point detection in anomalous-diffusion trajectories utilising machine-learning-based uncertainty estimates
Abstract When recording the movement of individual animals, cells or molecules one will often observe changes in their diffusive behaviour at certain points in time along their trajectory. In order to capture the different diffusive modes assembled in such heterogeneous trajectories it becomes necessary to segment them by determining these change-points. Such a change-point detection can be challenging for conventional statistical methods, especially when the changes are subtle. We here applyBayesian Deep Learningto obtain point-wise estimates of not only the anomalous diffusion exponent but also the uncertainties in these predictions from a single anomalous diffusion trajectory generated according to four theoretical models of anomalous diffusion. We show that we are able to achieve an accuracy similar to single-mode (without change-points) predictions as well as a well calibrated uncertainty predictions of this accuracy. Additionally, we find that the predicted uncertainties feature interesting behaviour at the change-points leading us to examine the capabilities of these predictions for change-point detection. While the series of predicted uncertainties on their own are not sufficient to improve change-point detection, they do lead to a performance boost when applied in combination with the predicted anomalous diffusion exponents.
more »
« less
- Award ID(s):
- 2112862
- PAR ID:
- 10556143
- Publisher / Repository:
- IOP Publishing Ltd
- Date Published:
- Journal Name:
- Journal of Physics: Photonics
- Volume:
- 6
- Issue:
- 4
- ISSN:
- 2515-7647
- Page Range / eLocation ID:
- 045025
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
All fluids exhibit large property-variations near the critical point in a region identified as the anomalous state. The anomaly starts in the liquid and extends well into the supercritical state, which can be identified thermodynamically using the Gibbs free energy (g). The specific heat, isobaric expansion, and isothermal compressibility parameters governing the transitions are: (cp/T), (vβ), and (vκ), rather cp, β, and κ. They are essentially the second-order derivatives of g and have two extrema (minimum, maximum); only maxima reported ever. When applied to the van der Waals fluid, these extrema exhibit closed loops on the phase-diagram to satisfy d3g = 0 and map the anomalous region. The predicted liquid-like to gas-like transitions are related to the ridges reported earlier, and the Widom delta falls between these loops. Evidently, in the anomalous region, both the liquid and the supercritical fluid need to be treated differently. Beyond the anomalous states, the supercritical fluids show monotonic, gradual changes in their properties. The analysis for argon, methane, nitrogen, carbon dioxide, and water validates the thermodynamic model, supports the stated observations, and identifies their delimiting pressures and temperatures for the anomalous states. It also demonstrates the applicability of the law of corresponding states. Notably, the critical point is a state where d3g = 0, the anomaly in the fluid's properties/behavior is maximal, and the governing parameters approach infinity. Also the following are presented: (a) the trajectory of the liquid–vapor line toward the melt-solid boundary and (b) a modified phase diagram (for water) exhibiting the anomalous region.more » « less
-
A trajectory is a sequence of observations in time and space, for examples, the path formed by maritime vessels, orbital debris, or aircraft. It is important to track and reconstruct vessel trajectories using the Automated Identification System (AIS) data in real-world applications for maritime navigation safety. In this project, we use the National Science Foundation (NSF)'s Algorithms for Threat Detection program (ATD) 2019 Challenge AIS data to develop novel trajectory reconstruction method. Given a sequence ofNunlabeled timestamped observations, the goal is to track trajectories by clustering the AIS points with predicted positions using the information from the true trajectoriesΧ. It is a natural way to connect the observed pointxîwith the closest point that is estimated by using the location, time, speed, and angle information from a set of the points under considerationxi∀i∈ {1, 2, …,N}. The introduced method is an unsupervised clustering-based method that does not train a supervised model which may incur a significant computational cost, so it leads to a real-time, reliable, and accurate trajectory reconstruction method. Our experimental results show that the proposed method successfully clusters vessel trajectories.more » « less
-
Abstract We introduce a novel geometry‐oriented methodology, based on the emerging tools of topological data analysis, into the change‐point detection framework. The key rationale is that change points are likely to be associated with changes in geometry behind the data‐generating process. While the applications of topological data analysis to change‐point detection are potentially very broad, in this paper, we primarily focus on integrating topological concepts with the existing nonparametric methods for change‐point detection. In particular, the proposed new geometry‐oriented approach aims to enhance detection accuracy of distributional regime shift locations. Our simulation studies suggest that integration of topological data analysis with some existing algorithms for change‐point detection leads to consistently more accurate detection results. We illustrate our new methodology in application to the two closely related environmental time series data sets—ice phenology of the Lake Baikal and the North Atlantic Oscillation indices, in a research query for a possible association between their estimated regime shift locations.more » « less
-
Social change in any society entails changes in both behaviours and institutions. We model a group-structured society in which the transmission of individual behaviour occurs in parallel with the selection of group-level institutions. We consider a cooperative behaviour that generates collective benefits for groups but does not spread between individuals on its own. Groups exhibit institutions that increase the diffusion of the behaviour within the group, but also incur a group cost. Groups adopt institutions in proportion to their fitness. Finally, the behaviour may also spread globally. We find that behaviour and institutions can be mutually reinforcing. But the model also generates behavioural source-sink dynamics when behaviour generated in institutionalized groups spreads to non-institutionalized groups and boosts their fitness. Consequently, the global diffusion of group-beneficial behaviour creates a pattern of institutional free-riding that limits the evolution of group-beneficial institutions. Our model suggests that, in a group-structured society, large-scale beneficial social change can be best achieved when the relevant behaviour and institutions remain correlated.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1088/2515-7647/ad884c
