skip to main content


This content will become publicly available on May 1, 2025

Title: Inverse covariance operators of multivariate nonstationary time series
For multivariate stationary time series many important properties, such as partial correlation, graphical models and autoregressive representations are encoded in the inverse of its spectral density matrix. This is not true for nonstationary time series, where the pertinent information lies in the inverse infinite dimensional covariance matrix operator associated with the multivariate time series. This necessitates the study of the covariance of a multivariate nonstationary time series and its relationship to its inverse. We show that if the rows/columns of the infinite dimensional covariance matrix decay at a certain rate then the rate (up to a factor) transfers to the rows/columns of the inverse covariance matrix. This is used to obtain a nonstationary autoregressive representation of the time series and a Baxter-type bound between the parameters of the autoregressive infinite representation and the corresponding finite autoregressive projection. The aforementioned results lay the foundation for the subsequent analysis of locally stationary time series. In particular, we show that smoothness properties on the covariance matrix transfer to (i) the inverse covariance (ii) the parameters of the vector autoregressive representation and (iii) the partial covariances. All results are set up in such a way that the constants involved depend only on the eigenvalue of the covariance matrix and can be applied in the high-dimensional settings with non-diverging eigenvalues.  more » « less
Award ID(s):
2210726
NSF-PAR ID:
10539260
Author(s) / Creator(s):
;
Publisher / Repository:
Bernoulli
Date Published:
Journal Name:
Bernoulli
Volume:
30
Issue:
2
ISSN:
1350-7265
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We consider the problem of inferring the conditional independence graph (CIG) of a high-dimensional stationary, multivariate long-range dependent (LRD) Gaussian time series. In a time series graph, each component of the vector series is represented by a distinct node, and associations between components are represented by edges between the corresponding nodes. In a recent work on graphical modeling of short-range dependent (SRD) Gaussian time series, the problem was cast as one of multi-attribute graph estimation for random vectors where a vector is associated with each node of the graph. At each node, the associated random vector consists of a time series component and its delayed copies. A theoretical analysis based on short-range dependence has been given in Tugnait (2022 ICASSP). In this paper we analyze this approach for LRD Gaussian time series and provide consistency results regarding convergence in the Frobenius norm of the inverse covariance matrix associated with the multi-attribute graph. 
    more » « less
  2. Representation learning is typically applied to only one mode of a data matrix, either its rows or columns. Yet in many applications, there is an underlying geometry to both the rows and the columns. We propose utilizing this coupled structure to perform co-manifold learning: uncovering the underlying geometry of both the rows and the columns of a given matrix, where we focus on a missing data setting. Our unsupervised approach consists of three components. We first solve a family of optimization problems to estimate a complete matrix at multiple scales of smoothness. We then use this collection of smooth matrix estimates to compute pairwise distances on the rows and columns based on a new multi-scale metric that implicitly introduces a coupling between the rows and the columns. Finally, we construct row and column representations from these multi- scale metrics. We demonstrate that our approach outperforms competing methods in both data visualization and clustering. 
    more » « less
  3. In this paper we frame a fairly comprehensive set of spacetime detection problems, where a subspace signal modulates the mean-value vector of a multivariate normal measurement and nonstationary additive noise determines the covariance matrix. The measured spacetime data matrix consists of multiple measurements in time. As time advances, the signal component moves around in a subspace, and the noise covariance matrix changes in scale. 
    more » « less
  4. A Bayesian lattice filtering and smoothing approach is proposed for fast and accurate modeling and inference in multivariate non‐stationary time series. This approach offers computational feasibility and interpretable time‐frequency analysis in the multivariate context. The proposed framework allows us to obtain posterior estimates of the time‐varying spectral densities of individual time series components, as well as posterior measurements of the time‐frequency relationships across multiple components, such as time‐varying coherence and partial coherence. The proposed formulation considers multivariate dynamic linear models (MDLMs) on the forward and backward time‐varying partial autocorrelation coefficients (TV‐VPARCOR). Computationally expensive schemes for posterior inference on the multivariate dynamic PARCOR model are avoided using approximations in the MDLM context. Approximate inference on the corresponding time‐varying vector autoregressive (TV‐VAR) coefficients is obtained via Whittle's algorithm. A key aspect of the proposed TV‐VPARCOR representations is that they are of lower dimension, and therefore more efficient, than TV‐VAR representations. The performance of the TV‐VPARCOR models is illustrated in simulation studies and in the analysis of multivariate non‐stationary temporal data arising in neuroscience and environmental applications. Model performance is evaluated using goodness‐of‐fit measurements in the time‐frequency domain and also by assessing the quality of short‐term forecasting.

     
    more » « less
  5. In this paper we explore partial coherence as a tool for evaluating the causal, anti-causal, or mixed-causal dependence of one time series on another. The key idea is to establish a connection between questions of causality and partial coherence. Once this connection is established, then a scale-invariant partial coherence statistic is used to resolve the question of temporal causality. This coherence statistic is shown to be a likelihood ratio. It may be computed from a composite covariance matrix or from its inverse, the information matrix. Numerical experiments demonstrate the application of partial coherence to the resolution of temporal causality. 
    more » « less