An official website of the United States government
Many nonequilibrium, active processes are observed at a coarse-grained level, where different microscopic configurations are projected onto the same observable state. Such “lumped” observables display memory, and in many cases, the irreversible character of the underlying microscopic dynamics becomes blurred, e.g., when the projection hides dissipative cycles. As a result, the observations appear less irreversible, and it is very challenging to infer the degree of broken time-reversal symmetry. Here we show, contrary to intuition, that by ignoring parts of the already coarse-grained state space we may—via a process called milestoning—improve entropy-production estimates. We present diverse examples where milestoning systematically renders observations “closer to underlying microscopic dynamics” and thereby improves thermodynamic inference from lumped data assuming a given range of memory, and we hypothesize that this effect is quite general. Moreover, whereas the correct general physical definition of time reversal in the presence of memory remains unknown, we here show by means of physically relevant examples that at least for semi-Markov processes of first and second order, waiting-time contributions arising from adopting a naive Markovian definition of time reversal generally must be discarded.
more »
« less
This content will become publicly available on January 21, 2026
Uncovering dissipation from coarse observables: A case study of a random walk with unobserved internal states
Inferring underlying microscopic dynamics from low-dimensional experimental signals is a central problem in physics, chemistry, and biology. As a trade-off between molecular complexity and the low-dimensional nature of experimental data, mesoscopic descriptions such as the Markovian master equation are commonly used. The states in such descriptions usually include multiple microscopic states, and the ensuing coarse-grained dynamics are generally non-Markovian. It is frequently assumed that such dynamics can nevertheless be described as a Markov process because of the timescale separation between slow transitions from one observed coarse state to another and the fast interconversion within such states. Here, we use a simple model of a molecular motor with unobserved internal states to highlight that (1) dissipation estimated from the observed coarse dynamics may significantly underestimate microscopic dissipation even in the presence of timescale separation and even when mesoscopic states do not contain dissipative cycles and (2) timescale separation is not necessarily required for the Markov approximation to give the exact entropy production, provided that certain constraints on the microscopic rates are satisfied. When the Markov approximation is inadequate, we discuss whether including memory effects can improve the estimate. Surprisingly, when we do so in a “model-free” way by computing the Kullback–Leibler divergence between the observed probability distributions of forward trajectories and their time reverses, this leads to poorer estimates of entropy production. Finally, we argue that alternative approaches, such as hidden Markov models, may uncover the dissipative nature of the microscopic dynamics even when the observed coarse trajectories are completely time-reversible.
more »
« less
- PAR ID:
- 10595304
- Publisher / Repository:
- AIP Publishing
- Date Published:
- Journal Name:
- The Journal of Chemical Physics
- Volume:
- 162
- Issue:
- 3
- ISSN:
- 0021-9606
- Page Range / eLocation ID:
- https://doi.org/10.1063/5.0247331
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Single-molecule fluorescence resonance energy transfer (FRET) experiments are commonly used to study the dynamics of molecular machines. While in vivo molecular processes often break time-reversal symmetry, the temporal directionality of cyclically operating molecular machines is often not evident from single-molecule FRET trajectories, especially in the most common two-color FRET studies. Solving a more quantitative problem of estimating the energy dissipation/entropy production by a molecular machine from single-molecule data is even more challenging. Here, we present a critical assessment of several practical methods of doing so, including Markov-model-based methods and a model-free approach based on an information-theoretical measure of entropy production that quantifies how (statistically) dissimilar observed photon sequences are from their time reverses. The Markov model approach is computationally feasible and may outperform model free approaches, but its performance strongly depends on how well the assumed model approximates the true microscopic dynamics. Markov models are also not guaranteed to give a lower bound on dissipation. Meanwhile, model-free, information-theoretical methods systematically underestimate entropy production at low photoemission rates, and long memory effects in the photon sequences make these methods demanding computationally. There is no clear winner among the approaches studied here, and all methods deserve to belong to a comprehensive data analysis toolkit.more » « less
-
An issue for molecular dynamics simulations is that events of interest often involve timescales that are much longer than the simulation time step, which is set by the fastest timescales of the model. Because of this timescale separation, direct simulation of many events is prohibitively computationally costly. This issue can be overcome by aggregating information from many relatively short simulations that sample segments of trajectories involving events of interest. This is the strategy of Markov state models (MSMs) and related approaches, but such methods suffer from approximation error because the variables defining the states generally do not capture the dynamics fully. By contrast, once converged, the weighted ensemble (WE) method aggregates information from trajectory segments so as to yield unbiased estimates of both thermodynamic and kinetic statistics. Unfortunately, errors decay no faster than unbiased simulation in WE as originally formulated and commonly deployed. Here, we introduce a theoretical framework for describing WE that shows that the introduction of an approximate stationary distribution on top of the stratification, as in nonequilibrium umbrella sampling (NEUS), accelerates convergence. Building on ideas from MSMs and related methods, we generalize the NEUS approach in such a way that the approximation error can be reduced systematically. We show that the improved algorithm can decrease the simulation time required to achieve the desired precision by orders of magnitude.more » « less
-
Living systems are built from microscopic components that function dynamically; they generate work with molecular motors, assemble and disassemble structures such as microtubules, keep time with circadian clocks, and catalyze the replication of DNA. How do we implement these functions in synthetic nanostructured materials to execute them before the onset of dissipative losses? Answering this question requires a quantitative understanding of when we can improve performance and speed while minimizing the dissipative losses associated with operating in a fluctuating environment. Here, we show that there are four modalities for optimizing dynamical functions that can guide the design of nanoscale systems. We analyze Markov models that span the design space: a clock, ratchet, replicator, and self-assembling system. Using stochastic thermodynamics and an exact expression for path probabilities, we classify these models of dynamical functions based on the correlation of speed with dissipation and with the chosen performance metric. We also analyze random networks to identify the model features that affect their classification and the optimization of their functionality. Overall, our results show that the possible nonequilibrium paths can determine our ability to optimize the performance of dynamical functions, despite ever-present dissipation, when there is a need for speed.more » « less
-
We present a bottom-up coarse-graining (CG) method to establish implicit-solvent CG modeling for polymers in solution, which conserves the dynamic properties of the reference microscopic system. In particular, tens to hundreds of bonded polymer atoms (or Lennard-Jones beads) are coarse-grained as one CG particle, and the solvent degrees of freedom are eliminated. The dynamics of the CG system is governed by the generalized Langevin equation (GLE) derived via the Mori-Zwanzig formalism, by which the CG variables can be directly and rigorously linked to the microscopic dynamics generated by molecular dynamics (MD) simulations. The solvent-mediated dynamics of polymers is modeled by the non-Markovian stochastic dynamics in GLE, where the memory kernel can be computed from the MD trajectories. To circumvent the difficulty in direct evaluation of the memory term and generation of colored noise, we exploit the equivalence between the non-Markovian dynamics and Markovian dynamics in an extended space. To this end, the CG system is supplemented with auxiliary variables that are coupled linearly to the momentum and among themselves, subject to uncorrelated Gaussian white noise. A high-order time-integration scheme is used to solve the extended dynamics to further accelerate the CG simulations. To assess, validate, and demonstrate the established implicit-solvent CG modeling, we have applied it to study four different types of polymers in solution. The dynamic properties of polymers characterized by the velocity autocorrelation function, diffusion coefficient, and mean square displacement as functions of time are evaluated in both CG and MD simulations. Results show that the extended dynamics with auxiliary variables can construct arbitrarily high-order CG models to reproduce dynamic properties of the reference microscopic system and to characterize long-time dynamics of polymers in solution.more » « less
