Variable parameter Uzawa method for solving a class of block three-by-three saddle point problems

A new SOR-Like method for the saddle point problems

In this paper, the nonlinear inexact Uzawa (NIU) methods for saddle point problems are studied. A further improved convergence result of the NIU algorithm for stabilized saddle point problems is presented, which results in much smaller convergence factor. This result can also be viewed as a generalization of some previous work for classical saddle point problems. Based on this result, we generalize some adaptive versions of the NIU algorithm with variable iteration parameters for classical saddle point problems to solve stabilized saddle point problems. Convergence analyses of these algorithms are presented. It shows that they converge under similar conditions as those in classical cases, which are more practical and without estimates on the extreme eigenvalues of the involved preconditioned systems. Numerical experiments are given to demonstrate the effectiveness of these algorithms over some original NIU algorithms.

In this paper, wavelet techniques are employed for the fast numerical solution of a control problem governed by an elliptic boundary value problem with boundary control. A quadratic cost functional involving natural norms of the state and the control is to be minimized. Firstly the constraint, the elliptic boundary value problem, is formulated in an appropriate weak form that allows to handle varying boundary conditions explicitly: the boundary conditions are treated by Lagrange multipliers, leading to a saddle point problem. This is combined with a fictitious domain approach in order to cover also more complicated boundaries. Deviating from standard approaches, we then use (biorthogonal) wavelets to derive an equivalent infinite discretized control problem which involves only e2-norms and -operators. Classical methods from optimization yield the corresponding optimality conditions in terms of two weakly coupled (still infinite) saddle point problems for which a unique solution exists. For deriving finite-dimensional systems which are uniformly invertible, stability of the discretizations has to be ensured. This together with the e2-setting circumvents the problem of preconditioning: all operators have uniformly bounded condition numbers independent of the discretization. In order to numerically solve the resulting (finite-dimensional) linear system of the weakly coupled saddle point problems, a fully iterative method is proposed which can be viewed as an inexact gradient scheme. It consists of a gradient algorithm as an outer iteration which alternatingly picks the two saddle point problems, and an inner iteration to solve each of the saddle point problems, exemplified in terms of the Uzawa algorithm. It is proved here that this strategy converges, provided that the inner systems are solved sufficiently well. Moreover, since the system matrix is well-conditioned, it is shown that in combination with a nested iteration strategy this iteration is asymptotically optimal in the sense that it provides the solution on discretization level J with an overall amount of arithmetic operations that is proportional to the number of unknows NJ on that level. Finally, numerical results are provided.

On a class of quadratic programs

Modified Uzawa methods for saddle point problems

Saddle point problems appear in many scientific and engineering applications. Hence, it is important to solve them fast with high accuracy. We have proposed the method for saddle point problems using block structure in order to solve them fast. In our proposed method, first, a linear system with multiple right-hand sides is solved instead of solving the saddle point problems directly. After that, a small linear system with a dense matrix is solved. In our previous work, it has been observed that our method is faster than the conventional approach, but the accuracy of the obtained approximate solutions is worse than the conventional one. In this paper, we propose to improve the accuracy of the approximate solutions of the saddle point problems by improving the accuracy of the solution of the small linear system using the mixed precision iterative refinement technique. Numerical experiments illustrate that the proposed approach improves the accuracy of the approximate solutions to the same extent as the conventional approach.

In this paper we consider additive Schwarz-type iteration methods for saddle point problems as smoothers in a multigrid method. Each iteration step of the additive Schwarz method requires the solutions of several small local saddle point problems. This method can be viewed as an additive version of a (multiplicative) Vanka-type iteration, well-known as a smoother for multigrid methods in computational fluid dynamics. It is shown that, under suitable conditions, the iteration can be interpreted as a symmetric inexact Uzawa method. In the case of symmetric saddle point problems the smoothing property, an important part in a multigrid convergence proof, is analyzed for symmetric inexact Uzawa methods including the special case of the additive Schwarz-type iterations. As an example the theory is applied to the Crouzeix-Raviart mixed finite element for the Stokes equations and some numerical experiments are presented.

Recently, by combining the preconditioned accelerated Hermitian and skew-Hermitian splitting (PAHSS) and the parameterized Uzawa (PU) methods, Zheng and Ma (Appl Math Comput 273, 217–225, 2016b) presented the PAHSS–PU method for saddle point problems. By adding a block lower triangular matrix to the coefficient matrix on two sides of the first equation of the PAHSS–PU iterative scheme, the modified PAHSS–PU (MPAHSS–PU) iteration method is proposed in this paper, which has a faster convergence rate than the PAHSS–PU one. Furthermore, changing the position of the parameters in the MPAHSS–PU method, we develop another new method referred to as the modified PPHSS-SOR (MPPHSS-SOR) iteration method for solving saddle point problems. We provide the convergence properties of the MPAHSS–PU and the MPPHSS-SOR iteration methods, which show that the new methods are convergent if the related parameters satisfy suitable conditions. Meanwhile, practical ways to choose iteration parameters for the proposed methods are developed. Finally, numerical experiments demonstrate that the MPAHSS–PU and the MPPHSS-SOR methods outperform some existing ones both on the number of iterations and the computational times.

BDDC algorithms have previously been extended to the saddle point problems arising from mixed formulations of elliptic and incompressible Stokes problems. In these two-level BDDC algorithms, all iterates are required to be in a benign space, a subspace in which the preconditioned operators are positive definite. This requirement can lead to large coarse problems, which have to be generated and factored by a direct solver at the beginning of the computation and they can ultimately become a bottleneck. An additional level is introduced in this paper to solve the coarse problem approximately and to remove this difficulty. This three-level BDDC algorithm keeps all iterates in the benign space and the conjugate gradient methods can therefore be used to accelerate the convergence. This work is an extension of the three-level BDDC methods for standard finite element discretization of elliptic problems and the same rate of convergence is obtained for the mixed formulation of the same problems. Estimate of the condition number for this three-level BDDC methods is provided and numerical experiments are discussed.

Recently, Guo et al. proposed a modified SOR-like (MSOR-like) iteration method for solving the nonsingular saddle point problem. In this paper, we further prove the semi-convergence of this method when it is applied to solve the singular saddle point problems under suitable conditions on the involved iteration parameters. Moreover, the optimal iteration parameters and the corresponding optimal semi-convergence factor for the MSOR-like method are determined. In addition, numerical experiments are used to show the feasibility and effectiveness of the MSOR-like method for solving singular saddle point problems, arising from the incompressible flow problems.

Overlapping Schwarz methods for mixed linear elasticity and Stokes problems

An iterative substructuring method with Lagrange multipliers is considered for second order elliptic problems, which is a variant of the FETI-DP method. The standard FETI-DP formulation is associated with the saddle-point problem which is induced from the minimization problem with a constraint for imposing the continuity across the interface. Starting from the slightly changed saddle-point problem by addition of a penalty term with a positive penalization parameter η, we propose a dual substructuring method which is implemented iteratively by the conjugate gradient method. In spite of the absence of any preconditioners, it is shown that the proposed method is numerically scalable in the sense that for a large value of η, the condition number of the resultant dual problem is bounded by a constant independent of both the subdomain size H and the mesh size h. Computational issues and numerical results are presented.

Variants of the Uzawa method for three-order block saddle point problem

In this paper, we further investigate the local Hermitian and skew-Hermitian splitting (LHSS) iteration method and the modified LHSS (MLHSS) iteration method for solving generalized nonsymmetric saddle point problems with nonzero (2,2) blocks. When A is non-symmetric positive definite, the convergence conditions are obtained, which generalize some results of Jiang and Cao [M.-Q. Jiang and Y. Cao, On local Hermitian and Skew-Hermitian splitting iteration methods for generalized saddle point problems, J. Comput. Appl. Math., 2009(231): 973-982] for the generalized saddle point problems to generalized nonsymmetric saddle point problems with nonzero (2,2) blocks. Numerical experiments show the effectiveness of the iterative methods.

In this paper, we study a saddle point problem and propose an inexact double primal-dual algorithm for solving the saddle point problem. The sequence generated by the proposed algorithm is proved to globally converge to the saddle point of the saddle point problem in the ergodic sense, and the convergence rate of the algorithm is also obtained. For the model of total variation image processing, the performance of the algorithm is demonstrated. Simulation results show that our method is more efficient in image denoising compared with existing methods.