Proximal point methods for the inverse problem of identifying parameters in beam models

The proximal point method (PPM) for solving maximal monotone operator inclusion problem is a highly powerful tool for algorithm design, analysis and interpretation. To accelerate convergence of the PPM, inertial PPM (iPPM) was proposed in the literature. In this note, we point out that some of the attractive properties of the PPM, e.g., the generated sequence is contractive with the set of solutions, do not hold anymore for iPPM. To partially inherit the advantages of the PPM and meanwhile incorporate inertial extrapolation steps, we propose an iPPM with alternating inertial steps. Our analyses show that the even subsequence generated by the proposed iPPM is contractive with the set of solutions. Moreover, we establish global convergence result under much relaxed conditions on the inertial extrapolation stepsizes, e.g., monotonicity is no longer needed and the stepsizes are significantly enlarged compared to existing methods. Furthermore, we establish certain $o(1/k)$ convergence rate results, where $k$ denotes the iteration counter. These features are new to inertial type PPMs.

The EM algorithm is a popular method for maximum likelihood estimation from incomplete data. This method may be viewed as a proximal point method for maximizing the log-likelihood function using an integral form of the Kullback-Leibler distance function. Motivated by this interpretation, we consider a proximal point method using an integral form of entropy-like distance function. We give a convergence analysis of the resulting proximal point method in the case where the cluster points lie in the interior of the objective function domain. This result is applied to a normal/independent example and a Gaussian mixture example to establish convergence of the EM algorithm on these examples. Further convergence analysis of the method for maximization over an orthant is given in low dimensions. Sublinear convergence and schemes for accelerating convergence are also discussed.

We consider an application of the proximal point method to variational inequality problems subject to box constraints, whose cost mappings possess order monotonicity properties instead of the usual monotonicity ones. Usually, convergence results of such methods require the additional boundedness assumption of the solutions set. We suggest another approach to obtaining convergence results for proximal point methods which is based on the assumption that the dual variational inequality is solvable. Then the solutions set may be unbounded. We present classes of economic equilibrium problems which satisfy such assumptions.

There has been a long history of using ordinary differential equations (ODEs) to understand the dynamics of discrete-time algorithms (DTAs). Surprisingly, there are still two fundamental and unanswered questions: (i) it is unclear how to obtain a suitable ODE from a given DTA, and (ii) it is unclear the connection between the convergence of a DTA and its corresponding ODEs. In this paper, we propose a new machinery—an $$O(s^r)$$ -resolution ODE framework—for analyzing the behavior of a generic DTA, which (partially) answers the above two questions. The framework contains three steps: 1. To obtain a suitable ODE from a given DTA, we define a hierarchy of $$O(s^r)$$ -resolution ODEs of a DTA parameterized by the degree r, where s is the step-size of the DTA. We present a principal approach to construct the unique $$O(s^r)$$ -resolution ODEs from a DTA; 2. To analyze the resulting ODE, we propose the $$O(s^r)$$ -linear-convergence condition of a DTA with respect to an energy function, under which the $$O(s^r)$$ -resolution ODE converges linearly to an optimal solution; 3. To bridge the convergence properties of a DTA and its corresponding ODEs, we define the properness of an energy function and show that the linear convergence of the $$O(s^r)$$ -resolution ODE with respect to a proper energy function can automatically guarantee the linear convergence of the DTA. To better illustrate this machinery, we utilize it to study three classic algorithms—gradient descent ascent (GDA), proximal point method (PPM) and extra-gradient method (EGM)—for solving the unconstrained minimax problem $$\min _{x\in \mathbb {R}^n} \max _{y\in \mathbb {R}^m} L(x,y)$$ . Their O(s)-resolution ODEs explain the puzzling convergent/divergent behaviors of GDA, PPM and EGM when L(x, y) is a bilinear function, and showcase that the interaction terms help the convergence of PPM/EGM but hurts the convergence of GDA. Furthermore, their O(s)-linear-convergence conditions not only unify the known scenarios when PPM and EGM have linear convergence, but also showcase that these two algorithms exhibit linear convergence in much broader contexts, including when solving a class of nonconvex-nonconcave minimax problems. Finally, we show how this ODE framework can help design new optimization algorithms for minimax problems, by studying the difference between the O(s)-resolution ODE of GDA and that of PPM/EGM.

We consider a general equilibrium problem defined on a convex set, whose cost bifunction may not be monotone. We show that this problem can be solved by the inexact proximal point method if there exists a solution to the dual problem. An application of this approach to nonlinearly constrained problems is also suggested.

The primary objective of this work is to present a rigorous treatment of various iterative methods for solving the elastography inverse problem of identifying cancerous tumors. From a mathematical standpoint, this inverse problem requires the identification of a variable parameter in a system of partial differential equations. We pose the nonlinear inverse problem as an optimization problem by using an output least-squares (OLS) and a modified output least-squares (MOLS) formulation. The optimality conditions then lead to a variational inequality problem which is solved using various gradient, extragradient, and proximal-point methods. Previously, only a few of these methods have been implemented, and there is currently no understanding of their relative efficiency and effectiveness. We present a thorough numerical comparison of the 15 iterative solvers which emerge from a variational inequality formulation.

In this chapter, we study a nonlinear inverse problem in linear elasticity relating to tumor identification by an equation error formulation. This approach leads to a variational inequality as a necessary and sufficient optimality condition. We give complete convergence analysis for the proposed equation error method. Since the considered problem is highly ill-posed, we develop a stable computational framework by employing a variety of proximal point methods and compare their performance with the more commonly used Tikhonov regularization.

Metric subregularity and the proximal point method

We present a unified convergence rate analysis of iterative methods for solving the variational inequality problem. Our results are based on certain error bounds; they subsume and extend the linear and sublinear rates of convergence established in several previous studies. We also derive a new error bound for $\gamma$-strictly monotone variational inequalities. The class of algorithms covered by our analysis in fairly broad. It includes some classical methods for variational inequalities, e.g., the extragradient, matrix splitting, and proximal point methods. For these methods, our analysis gives estimates not only for linear convergence (which had been studied extensively), but also sublinear, depending on the properties of the solution. In addition, our framework includes a number of algorithms to which previous studies are not applicable, such as the infeasible projection methods, a separation-projection method, (inexact) hybrid proximal point methods, and some splitting techniques. Finally, our analysis covers certain feasible descent methods of optimization, for which similar convergence rate estimates have been recently obtained by Luo [14].

We study the relationships between three concepts which arise in connection with variational inequality problems: central paths defined by arbitrary barriers, generalized proximal point methods (where a Bregman distance substitutes for the Euclidean one), and Cauchy trajectory in Riemannian manifolds. First we prove that under rather general hypotheses the central path defined by a general barrier for a monotone variational inequality problem is well defined, bounded, and continuous and converges to the analytic center of the solution set (with respect to the given barrier), thus generalizing results which deal only with complementarity problems and with the logarithmic barrier. Next we prove that a sequence generated by the proximal point method with the Bregman distance naturally induced by the barrier function converges precisely to the same point. Furthermore, for a certain class of problems (including linear programming), such a sequence is contained in the central path, making the concepts of central path and generalized proximal point sequence virtually equivalent. Finally we prove that for this class of problems the central path also coincides with the Cauchy trajectory in the Riemannian manifold defined on the positive orthant by a metric given by the Hessian of the barrier (i.e., a curve whose direction at each point is the negative gradient of the objective function at that point in the Riemannian metric).

This paper is mainly devoted to the study and applications of Hölder metric subregularity (or metric $q$-subregularity of order $q\in(0,1]$) for general set-valued mappings between infinite-dimensional spaces. Employing advanced techniques of variational analysis and generalized differentiation, we derive neighborhood and point-based sufficient conditions as well as necessary conditions for $q$-metric subregularity with evaluating the exact subregularity bound, which are new even for the conventional (first-order) metric subregularity in both finite and infinite dimensions. In this way we also obtain new fractional error bound results for composite polynomial systems with explicit calculating fractional exponents. Finally, metric $q$-subregularity is applied to conduct a quantitative convergence analysis of the classical proximal point method (PPM) for finding zeros of maximal monotone operators on Hilbert spaces.

This paper deals with the study of weak sharp solutions for nonsmooth variational inequalities and finite convergence property of the proximal point method. We present several characterizations for weak sharpness of the solutions set of nonsmooth variational inequalities without using the gap functions. We show that under weak sharpness of the solutions set, the sequence generated by proximal point methods terminates after a finite number of iterations. We also give an upper bound for the number of iterations for which the sequence generated by the exact proximal point methods terminates.

Fixed-Point Algorithms for Inverse Problems in Science and Engineering presents some ofthe most recent work from top-notch researchers studying projection and other first-order fixed-point algorithms in several areas of mathematics and the applied sciences. The material presented provides a survey of the state-of-the-art theory and practice in fixed-point algorithms, identifying emerging problems driven by applications, and discussing new approaches for solving these problems. This book incorporates diverse perspectives from broad-ranging areas of research including, variational analysis, numerical linear algebra, biotechnology, materials science, computational solid-state physics, and chemistry. Topics presented include: Theory of Fixed-point algorithms: convex analysis, convex optimization, subdifferential calculus, nonsmooth analysis, proximal point methods, projection methods, resolvent and related fixed-point theoretic methods, and monotone operator theory. Numerical analysis of fixed-point algorithms: choice of step lengths, of weights, of blocks for block-iterative and parallel methods, and of relaxation parameters; regularization of ill-posed problems; numerical comparison of various methods. Areas of Applications: engineering (image and signal reconstruction and decompression problems), computer tomography and radiation treatment planning (convex feasibility problems), astronomy (adaptive optics), crystallography (molecular structure reconstruction), computational chemistry (molecular structure simulation) and other areas. Because of the variety of applications presented, this book can easily serve as a basis for new and innovated research and collaboration.

PurposeThis work presents a topology optimization methodology for designing microarchitectures of phononic crystals. The objective is to get microstructures having, as a consequence of wave propagation phenomena in these media, bandgaps between two specified bands. An additional target is to enlarge the range of frequencies of these bandgaps.Design/methodology/approachThe resulting optimization problem is solved employing an augmented Lagrangian technique based on the proximal point methods. The main primal variable of the Lagrangian function is the characteristic function determining the spatial geometrical arrangement of different phases within the unit cell of the phononic crystal. This characteristic function is defined in terms of a level-set function. Descent directions of the Lagrangian function are evaluated by using the topological derivatives of the eigenvalues obtained through the dispersion relation of the phononic crystal.FindingsThe description of the optimization algorithm is emphasized, and its intrinsic properties to attain adequate phononic crystal topologies are discussed. Particular attention is addressed to validate the analytical expressions of the topological derivative. Application examples for several cases are presented, and the numerical performance of the optimization algorithm for attaining the corresponding solutions is discussed.Originality/valueThe original contribution results in the description and numerical assessment of a topology optimization algorithm using the joint concepts of the level-set function and topological derivative to design phononic crystals.

We study the convergence of exact and inexact versions of the proximal point method with a generalized regularization function in Hadamard manifolds for solving scalar and vectorial optimization problems involving Lipschitz functions. We consider a local dominance property of the directional derivative of the objective function over the regularization term in order to obtain that cluster points of the sequence are stationary points. Under an additional assumption, we prove that every cluster point of the sequence is a minimizer in the scalar case and a weak efficient point in the vectorial case. Our results extend some of the existing ones in the literature about optimization on manifolds.