skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Pyleoclim: Paleoclimate Timeseries Analysis and Visualization With Python
Abstract We present a Python package geared toward the intuitive analysis and visualization of paleoclimate timeseries,Pyleoclim. The code is open‐source, object‐oriented, and built upon the standard scientific Python stack, allowing users to take advantage of a large collection of existing and emerging techniques. We describe the code's philosophy, structure, and base functionalities and apply it to three paleoclimate problems: (a) orbital‐scale climate variability in a deep‐sea core, illustrating spectral, wavelet, and coherency analysis in the presence of age uncertainties; (b) correlating a high‐resolution speleothem to a climate field, illustrating correlation analysis in the presence of various statistical pitfalls (including age uncertainties); (c) model‐data confrontations in the frequency domain, illustrating the characterization of scaling behavior. We show how the package may be used for transparent and reproducible analysis of paleoclimate and paleoceanographic datasets, supporting Findable, Accessible, Interoperable, and Reusable software and an open science ethos. The package is supported by an extensive documentation and a growing library of tutorials shared publicly as videos and cloud‐executable Jupyter notebooks, to encourage adoption by new users.  more » « less
Award ID(s):
2126510 2002556
PAR ID:
10375826
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Paleoceanography and Paleoclimatology
Volume:
37
Issue:
10
ISSN:
2572-4517
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ABSTRACT Weather at the mid‐latitudes is governed by cyclones and anticyclones mostly migrating eastward. These weather systems cause the jet streams to undulate; the meandering patterns are known as the Rossby waves. Occasionally, Rossby waves bring forth localised extreme weather phenomena. An example of a finite‐amplitude wave phenomenon is atmospheric blocking, which is often associated with heat waves and droughts. Recent development of a finite‐amplitude local wave activity (FALWA) theory by Nakamura and collaborators enables comprehensive analysis of the dynamics of finite‐amplitude Rossby waves observed in climate data, which helps to understand the drivers of their life cycles. Despite the simplicity of interpretation it brings about, to apply the FALWA diagnostic to climate data requires more involved calculations than the traditional Eulerian framework. This article introduces the open‐source Python packagefalwa,which encapsulates the FALWA diagnostics implemented on gridded climate data presented in the authors' previous publications. It reviews the essence of the FALWA theory, the corresponding components in the package that implement the calculations, and where users can find sample notebooks to start with. It aims to serve as a road map for new users to easily navigate through this package. The latter half of this article documents the practices of the developers, which include the documentation tools, continuous integration practice, and repository maintenance using automated GitHub functionalities. The authors also discuss existing numerical issues and future improvement plans. This open‐source project aims to promote the broader application of FALWA diagnostics on climate data and model outputs by streamlining complex numerical computations. 
    more » « less
  2. Abstract Paleoclimate reconstruction relies on estimates of spatiotemporal relationships among climate quantities to interpolate between proxy data. This work quantifies how structural uncertainties in those relationships translate to uncertainties in reconstructions of past climate. We develop and apply a data assimilation uncertainty quantification approach to paleoclimate networks and observational uncertainties representative of data for the last millennium. We find that structural uncertainties arising from uncertain spatial covariance relationships typically contribute 10% of the total uncertainty in reconstructed temperature variability at small (∼200 km), continental, and hemispheric length scales, with larger errors (50% or larger) in regions where long‐range climate covariances are least certain. These structural uncertainties contribute far more to errors in uncertainty quantification, sometimes by a factor of 5 or higher. Accounting for and reducing uncertainties in climate model dynamics and resulting covariance relationships will improve paleoclimate reconstruction accuracy. 
    more » « less
  3. Abstract. Climate field reconstruction (CFR) refers to the estimation of spatiotemporal climate fields (such as surface temperature) from a collection of pointwise paleoclimate proxy datasets. Such reconstructions can provide rich information on climate dynamics and provide an out-of-sample validation of climate models. However, most CFR workflows are complex and time-consuming, as they involve (i) preprocessing of the proxy records, climate model simulations, and instrumental observations; (ii) application of one or more statistical methods; and (iii) analysis and visualization of the reconstruction results. Historically, this process has lacked transparency and accessibility, limiting reproducibility and experimentation by non-specialists. This article presents an open-source and object-oriented Python package called cfr that aims to make CFR workflows easy to understand and conduct, saving climatologists from technical details and facilitating efficient and reproducible research. cfr provides user-friendly utilities for common CFR tasks such as proxy and climate data analysis and visualization, proxy system modeling, and modularized workflows for multiple reconstruction methods, enabling methodological intercomparisons within the same framework. The package is supported with extensive documentation of the application programming interface (API) and a growing number of tutorial notebooks illustrating its usage. As an example, we present two cfr-driven reconstruction experiments using the PAGES 2k temperature database applying the last millennium reanalysis (LMR) paleoclimate data assimilation (PDA) framework and the graphical expectation–maximization (GraphEM) algorithm, respectively. 
    more » « less
  4. Abstract Collective motion, that is the coordinated spatial and temporal organisation of individuals, is a core element in the study of collective animal behaviour. The self‐organised properties of how a group moves influence its various behavioural and ecological processes, such as predator–prey dynamics, social foraging and migration. However, little is known about the inter‐ and intra‐specific variation in collective motion. Despite the significant advancement in high‐resolution tracking of multiple individuals within groups, providing collective motion data for animals in the laboratory and the field, a framework to perform quantitative comparisons across species and contexts is lacking.Here, we present theswaRmversepackage. Building on two existing R packages,trackdfandswaRm,swaRmverseenables the identification and analysis of collective motion ‘events’, as presented in Papadopoulou et al. (2023), creating a unit of comparison across datasets. We describe the package's structure and showcase its functionality using existing datasets from several species and simulated trajectories from an agent‐based model.From positional time‐series data for multiple individuals (x‐y‐t‐id),swaRmverseidentifies events of collective motion based on the distribution of polarisation and group speed. For each event, a suite of validated biologically meaningful metrics are calculated, and events are placed into a ‘swarm space’ through dimensional reduction techniques.Our package provides the first automated pipeline enabling the analysis of data on collective behaviour. The package allows the calculation and use of complex metrics for users without a strong quantitative background and will promote communication and data‐sharing across disciplines, standardising the quantification of collective motion across species and promoting comparative investigations. 
    more » « less
  5. Abstract Population dynamics play a central role in the historical and current development of fundamental and applied ecological science. The nascent culture of open data promises to increase the value of population dynamics studies to the field of ecology. However, synthesis of population data is constrained by the difficulty in identifying relevant datasets, by the heterogeneity of available data and by access to raw (as opposed to aggregated or derived) observations.To obviate these issues, we built a relational database,popler, and itsRclient, the library popler.popleraccommodates the vast majority of population data under a common structure, and without the need for aggregating raw observations. The popler R library is designed for users unfamiliar with the structure of the database and with the SQL language. ThisRlibrary allows users to identify, download, explore and cite datasets salient to their needs.We implemented popler as a PostgreSQL instance, where we stored population data originated by the United States Long Term Ecological Research (LTER) Network. Our focus on the US LTER data aims to leverage the potential of this vast open data resource. The database currently contains 305 datasets from 25 LTER sites.popleris designed to accommodate automatic updates of existing datasets, and to accommodate additional datasets from LTER as well as non‐LTER studies.The combination of the online database and theRlibrary popler is a resource for data synthesis efforts in population ecology. The common structure ofpoplersimplifies comparative analyses, and the availability of raw data confers flexibility in data analysis. The popler R library maximizes these opportunities by providing a user‐friendly interface to the online database. 
    more » « less