An official website of the United States government
In this paper, we provide a theoretical analysis for a preconditioned steepest descent (PSD) iterative solver that improves the computational time of a finite difference numerical scheme for the Cahn-Hilliard equation with Flory-Huggins energy potential. In the numerical design, a convex splitting approach is applied to the chemical potential such that the logarithmic and the surface diffusion terms are treated implicitly while the expansive concave term is treated with an explicit update. The nonlinear and singular nature of the logarithmic energy potential makes the numerical implementation very challenging. However, the positivity-preserving property for the logarithmic arguments, unconditional energy stability, and optimal rate error estimates have been established in a recent work and it has been shown that successful solvers ensure a similar positivity-preserving property at each iteration stage. Therefore, in this work, we will show that the PSD solver ensures a positivity-preserving property at each iteration stage. The PSD solver consists of first computing a search direction (which requires solving a constant-coefficient Poisson-like equation) and then takes a one-parameter optimization step over the search direction in which the Newton iteration becomes very powerful. A theoretical analysis is applied to the PSD iteration solver and a geometric convergence rate is proved for the iteration. In particular, the strict separation property of the numerical solution, which indicates a uniform distance between the numerical solution and the singular limit values of ±1 for the phase variable, plays an essential role in the iteration convergence analysis. A few numerical results are presented to demonstrate the robustness and efficiency of the PSD solver.
more »
« less
Convergence analysis of a block preconditioned steepest descent eigensolver with implicit deflation
Abstract Gradient‐type iterative methods for solving Hermitian eigenvalue problems can be accelerated by using preconditioning and deflation techniques. A preconditioned steepest descent iteration with implicit deflation (PSD‐id) is one of such methods. The convergence behavior of the PSD‐id is recently investigated based on the pioneering work of Samokish on the preconditioned steepest descent method (PSD). The resulting non‐asymptotic estimates indicate a superlinear convergence of the PSD‐id under strong assumptions on the initial guess. The present paper utilizes an alternative convergence analysis of the PSD by Neymeyr under much weaker assumptions. We embed Neymeyr's approach into the analysis of the PSD‐id using a restricted formulation of the PSD‐id. More importantly, we extend the new convergence analysis of the PSD‐id to a practically preferred block version of the PSD‐id, or BPSD‐id, and show the cluster robustness of the BPSD‐id. Numerical examples are provided to validate the theoretical estimates.
more »
« less
- Award ID(s):
- 1913364
- PAR ID:
- 10482962
- Publisher / Repository:
- Wiley
- Date Published:
- Journal Name:
- Numerical Linear Algebra with Applications
- Volume:
- 30
- Issue:
- 5
- ISSN:
- 1070-5325
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Abstract How to choose the step size of gradient descent method has been a popular subject of research. In this paper we propose a modified limited memory steepest descent method (MLMSD). In each iteration we propose a selection rule to pick a unique step size from a candidate set, which is calculated by Fletcher’s limited memory steepest descent method (LMSD), instead of going through all the step sizes in a sweep, as in Fletcher’s original LMSD algorithm. MLMSD is motivated by an inexact super-linear convergence rate analysis. The R-linear convergence of MLMSD is proved for a strictly convex quadratic minimization problem. Numerical tests are presented to show that our algorithm is efficient and robust.more » « less
-
Abstract First-order optimization methods tend to inherently favor certain solutions over others when minimizing an underdetermined training objective that has multiple global optima. This phenomenon, known asimplicit bias, plays a critical role in understanding the generalization capabilities of optimization algorithms. Recent research has revealed that in separable binary classification tasks gradient-descent-based methods exhibit an implicit bias for the$$\ell _2$$ -maximal margin classifier. Similarly, generic optimization methods, such as mirror descent and steepest descent, have been shown to converge to maximal margin classifiers defined by alternative geometries. While gradient-descent-based algorithms provably achievefastimplicit bias rates, corresponding rates in the literature for generic optimization methods are relatively slow. To address this limitation, we present a series of state-of-the-art implicit bias rates for mirror descent and steepest descent algorithms. Our primary technique involves transforming a generic optimization algorithm into an online optimization dynamic that solves a regularized bilinear game, providing a unified framework for analyzing the implicit bias of various optimization methods. Our accelerated rates are derived by leveraging the regret bounds of online learning algorithms within this game framework. We then show the flexibility of this framework by analyzing the implicit bias inadversarial training, and again obtain significantly improved convergence rates.more » « less
-
Reductions of the self-consistent mean field theory model of amphiphilic molecules in solvent can lead to a singular family of functionalized Cahn-Hilliard (FCH) energies. We modify these energies, mollifying the singularities to stabilize the computation of the gradient flows and develop a series of benchmark problems that emulate the “morphological complexity” observed in experiments. These benchmarks investigate the delicate balance between the rate of absorption of amphiphilic material onto an interface and a least energy mechanism to disperse the arriving mass. The re- sult is a trichotomy of responses in which two-dimensional interfaces either lengthen by a regularized motion against curvature, undergo pearling bifurcations, or split di- rectly into networks of interfaces. We evaluate a number of schemes that use second or- der backward differentiation formula (BDF2) type time stepping coupled with Fourier pseudo-spectral spatial discretization. The BDF2-type schemes are either based on a fully implicit time discretization with a preconditioned steepest descent (PSD) nonlin- ear solver or upon linearly implicit time discretization based on the standard implicit- explicit (IMEX) and the scalar auxiliary variable (SAV) approaches. We add an ex- ponential time differencing (ETD) scheme for comparison purposes.more » « less
-
Abstract We obtain rigorous large time asymptotics for the Landau–Lifshitz (LL) equation in the soliton free case by extending the nonlinear steepest descent method to genus 1 surfaces. The methods presented in this paper pave the way to a rigorous analysis of other integrable equations on the torus and enable asymptotic analysis on different regimes of the LL equation.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1002/nla.2498
