## Structured preconditioners for nonsingular matrices of block two-by-two structures

Venue: | Math. Comp |

Citations: | 10 - 5 self |

### BibTeX

@ARTICLE{Bai_structuredpreconditioners,

author = {Zhong-zhi Bai},

title = {Structured preconditioners for nonsingular matrices of block two-by-two structures},

journal = {Math. Comp},

year = {},

pages = {791--815}

}

### OpenURL

### Abstract

Abstract. For the large sparse block two-by-two real nonsingular matrices, we establish a general framework of practical and efficient structured preconditioners through matrix transformation and matrix approximations. For the specific versions such as modified block Jacobi-type, modified block Gauss-Seidel-type, and modified block unsymmetric (symmetric) Gauss-Seidel-type preconditioners, we precisely describe their concrete expressions and deliberately analyze eigenvalue distributions and positive definiteness of the preconditioned matrices. Also, we show that when these structured preconditioners are employed to precondition the Krylov subspace methods such as GMRES and restarted GMRES, fast and effective iteration solvers can be obtained for the large sparse systems of linear equations with block two-by-two coefficient matrices. In particular, these structured preconditioners can lead to efficient and high-quality preconditioning matrices for some typical matrices from the real-world applications. 1.

### Citations

1341 |
Practical Optimization
- Gill, Murray, et al.
- 1981
(Show Context)
Citation Context ...ety of scientific and engineering applications, including computational fluid dynamics[21, 23, 26], mixed finite element approximation of elliptic partial differential equations [16, 38], optimization=-=[25, 30, 34]-=-, optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geoph... |

1319 | GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems - Saad, Schultz - 1986 |

955 |
Mixed and Hybrid Finite Element Methods
- Brezzi, Fortin
- 1991
(Show Context)
Citation Context ...-(1.2) arise in a variety of scientific and engineering applications, including computational fluid dynamics[21, 23, 26], mixed finite element approximation of elliptic partial differential equations =-=[16, 38]-=-, optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networ... |

600 |
Numerical Methods for Least Squares Problems
- Björck
- 1996
(Show Context)
Citation Context ..., 26], mixed finite element approximation of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation=-=[14]-=-, stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geophysical data[31], and so on. As we have known, preconditioned Krylov subspace methods[... |

494 |
Iterative Solution Methods
- Axelsson
- 1994
(Show Context)
Citation Context ...me special cases of the block two-bytwo matrix A in (1.2). Besides specialized incomplete factorization preconditioners[17, 18] we mention, among others, algebraic multilevel iteration preconditioners=-=[2, 3, 4, 5, 12]-=-, block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners [24, 34, 38, 10], and b... |

308 |
Introduction to applied mathematics
- Strang
- 1986
(Show Context)
Citation Context ...tial equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis=-=[44]-=-, electrical networks[44], inversion of geophysical data[31], and so on. As we have known, preconditioned Krylov subspace methods[40] are efficient iterative solvers for the system of linear equations... |

200 |
Numerical Methods for Nonlinear Variational Problems
- Glowinski
- 1984
(Show Context)
Citation Context ...y if its Schur complement SA = C − F B −1 E is nonsingular. Linear systems of the form (1.1)-(1.2) arise in a variety of scientific and engineering applications, including computational fluid dynamics=-=[21, 23, 26]-=-, mixed finite element approximation of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14],... |

179 |
Variational iterative methods for nonsymmetric systems of linear equations
- Eisenstat, Elman, et al.
- 1983
(Show Context)
Citation Context ...ned linear system of coefficient matrix � A = KL, KR, or K, respectively. Because Theorems 3.2, 3.4, 3.6 and 3.8 guarantee the positive definiteness of the preconditioned matrix � A, it is known from =-=[20]-=- and [41, pp. 866] that the following error bound for the correspondingly preconditioned GMRES holds: �r (k) �2 ≤ � 1 − (λmin( � H)) 2 λmax( � A T � A) � k 2 �r (0) �2, where � H = 1 2 ( � A + � A T )... |

160 |
The Finite Element Method in Electromagnetics
- Jin
- 2002
(Show Context)
Citation Context ... θh, 2, −1 − 1 2 θh) ∈ Rq×q is a tridiagonal matrix, Ω = h 2 · diag(ω 2 1 , ω2 2 , . . . , ω2 q) ∈ R q×q is a nonnegative diagonal matrix, G = (gij) ∈ R q×q , and ⊗ denotes the Kronecker product. See =-=[33, 1]-=-. Concretely, in our computations we take θ = 1, ωi = 16π (i = 1, 2, . . . , q), and gij = 1 (i+j) 2 (i, j = 1, 2, . . . , q). Let B ≈ LBRB be an incomplete triangular factorization of the matrix bloc... |

154 |
Iterative Methods for Sparse Linear Systems. 2nd edition
- Saad
- 2003
(Show Context)
Citation Context ...], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geophysical data[31], and so on. As we have known, preconditioned Krylov subspace methods=-=[40]-=- are efficient iterative solvers for the system of linear equations (1.1)-(1.2), and effective and high-quality preconditioners play a crucial role to guarantee their fast convergence and economical c... |

141 |
Analysis and Simulation of Semiconductor Devices
- Selberherr
- 1984
(Show Context)
Citation Context ...tion of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device=-=[36, 42, 43]-=-, structural analysis[44], electrical networks[44], inversion of geophysical data[31], and so on. As we have known, preconditioned Krylov subspace methods[40] are efficient iterative solvers for the s... |

134 |
Practical Methods for Optimal Control Using Nonlinear Programming
- Betts
- 2001
(Show Context)
Citation Context ...ring applications, including computational fluid dynamics[21, 23, 26], mixed finite element approximation of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control=-=[13]-=-, weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geophysical data[31], and ... |

116 |
Matrix Computations, 3rd Edition
- Golub, Loan
- 1996
(Show Context)
Citation Context ...le, they may be the incomplete lower-upper triangular factors [2, 40], the incomplete orthogonal triangular factors [8], the approximate inverse preconditioners [40], the splitting iteration matrices =-=[2, 6, 7, 27]-=-, the multigrid or the algebraic multilevel approximations [2, 3, 4, 5, 12], or even technical combinations of the above-mentioned matrices, to the matrix blocks B and C, respectively. In particular, ... |

99 |
Inexact and preconditioned Uzawa algorithms for saddle-point problems
- Elman, Golub
- 1994
(Show Context)
Citation Context ...rs[17, 18] we mention, among others, algebraic multilevel iteration preconditioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners=-=[15, 19, 22, 28, 29, 39, 45]-=-, block definite and indefinite preconditioners [24, 34, 38, 10], and block triangular preconditioners[35, 37, 10]. Theoretical analyses and experimental results have shown that these preconditioners ... |

81 | A note on preconditioning for indefinite linear systems
- Murphy, Golub, et al.
(Show Context)
Citation Context ...omplement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners [24, 34, 38, 10], and block triangular preconditioners=-=[35, 37, 10]-=-. Theoretical analyses and experimental results have shown that these preconditioners may lead to nicely clustered eigenvalue distributions of the preconditioned matrices and, hence, result in fast co... |

70 | A.: Analysis of the inexact uzawa algorithm for saddle point problems
- Bramble, Pasciak, et al.
- 1997
(Show Context)
Citation Context ...rs[17, 18] we mention, among others, algebraic multilevel iteration preconditioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners=-=[15, 19, 22, 28, 29, 39, 45]-=-, block definite and indefinite preconditioners [24, 34, 38, 10], and block triangular preconditioners[35, 37, 10]. Theoretical analyses and experimental results have shown that these preconditioners ... |

62 | Performance and analysis of saddle point preconditioners for the discrete steady-state Navier
- Elman, Silvester, et al.
(Show Context)
Citation Context ...y if its Schur complement SA = C − F B −1 E is nonsingular. Linear systems of the form (1.1)-(1.2) arise in a variety of scientific and engineering applications, including computational fluid dynamics=-=[21, 23, 26]-=-, mixed finite element approximation of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14],... |

56 |
On optimization techniques for solving nonlinear inverse problems. Inverse problems
- Haber, Ascher, et al.
- 1263
(Show Context)
Citation Context ...ontrol[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geophysical data=-=[31]-=-, and so on. As we have known, preconditioned Krylov subspace methods[40] are efficient iterative solvers for the system of linear equations (1.1)-(1.2), and effective and high-quality preconditioners... |

54 |
The stationary semiconductor device equations
- Markowich
- 1986
(Show Context)
Citation Context ...tion of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device=-=[36, 42, 43]-=-, structural analysis[44], electrical networks[44], inversion of geophysical data[31], and so on. As we have known, preconditioned Krylov subspace methods[40] are efficient iterative solvers for the s... |

40 | On the solution of equality constrained quadratic programming problems arising in optimization
- Gould, Hribar, et al.
(Show Context)
Citation Context ...ety of scientific and engineering applications, including computational fluid dynamics[21, 23, 26], mixed finite element approximation of elliptic partial differential equations [16, 38], optimization=-=[25, 30, 34]-=-, optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geoph... |

40 |
Introduction to Applied Mathematics (WellesleyCambridge
- Strang
- 1986
(Show Context)
Citation Context ...equations [16, 38], optimization [25, 30, 34], optimal control [13], weighted and equality constrained least squares estimation [14], stationary semiconductor device [36, 42, 43], structural analysis =-=[44]-=-, electrical networks [44], inversion of geophysical data [31], and so on. As we have known, preconditioned Krylov subspace methods [40] are efficient iterative solvers for the system of linear equati... |

38 |
The factorization of sparse symmetric indefinite matrices
- DUFF, GOULD, et al.
- 1991
(Show Context)
Citation Context ...A number of structured preconditioners have been studied in the literature for some special cases of the block two-bytwo matrix A in (1.2). Besides specialized incomplete factorization preconditioners=-=[17, 18]-=- we mention, among others, algebraic multilevel iteration preconditioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 2... |

37 |
Minimum residual methods for augmented systems
- Fischer, Ramage, et al.
- 1998
(Show Context)
Citation Context ...tioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners =-=[24, 34, 38, 10]-=-, and block triangular preconditioners[35, 37, 10]. Theoretical analyses and experimental results have shown that these preconditioners may lead to nicely clustered eigenvalue distributions of the pre... |

33 |
Block-diagonal and indefinite symmetric preconditioners for mixed finite element formulations
- Perugia, Simoncini
(Show Context)
Citation Context ...-(1.2) arise in a variety of scientific and engineering applications, including computational fluid dynamics[21, 23, 26], mixed finite element approximation of elliptic partial differential equations =-=[16, 38]-=-, optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networ... |

32 |
Block-triangular preconditioners for saddle point problems with a penalty term
- Klawonn
- 1998
(Show Context)
Citation Context ...omplement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners [24, 34, 38, 10], and block triangular preconditioners=-=[35, 37, 10]-=-. Theoretical analyses and experimental results have shown that these preconditioners may lead to nicely clustered eigenvalue distributions of the preconditioned matrices and, hence, result in fast co... |

24 |
An iteration for indefinite systems and its application to the Navier-Stokes equations
- GOLUB, WATHEN
- 1998
(Show Context)
Citation Context ...rs[17, 18] we mention, among others, algebraic multilevel iteration preconditioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners=-=[15, 19, 22, 28, 29, 39, 45]-=-, block definite and indefinite preconditioners [24, 34, 38, 10], and block triangular preconditioners[35, 37, 10]. Theoretical analyses and experimental results have shown that these preconditioners ... |

23 | Exploiting zeros on the diagonal in the direct solution of indefinite sparse symmetric linear systems
- DUFF, K
- 1996
(Show Context)
Citation Context ...A number of structured preconditioners have been studied in the literature for some special cases of the block two-bytwo matrix A in (1.2). Besides specialized incomplete factorization preconditioners=-=[17, 18]-=- we mention, among others, algebraic multilevel iteration preconditioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 2... |

16 | Preconditioners for saddle point problems arising in computational fluid dynamics
- Elman
(Show Context)
Citation Context ...y if its Schur complement SA = C − F B −1 E is nonsingular. Linear systems of the form (1.1)-(1.2) arise in a variety of scientific and engineering applications, including computational fluid dynamics=-=[21, 23, 26]-=-, mixed finite element approximation of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14],... |

15 | A class of incomplete orthogonal factorization methods. I: Methods and theories
- Bai, Duff, et al.
(Show Context)
Citation Context ...matrix I. There are many possible choices of the matrices LB, RB and LC, RC. For example, they may be the incomplete lower-upper triangular factors[2, 40], the incomplete orthogonal triangular factors=-=[8]-=-, the approximate inverse preconditioners[40], the splitting iteration matrices[2, 6, 7, 27], the multigrid or the algebraic multilevel approximations[2, 3, 4, 5, 12], or even technical combinations o... |

12 |
Accelerated overrelaxation method
- Hadjidimos
- 1978
(Show Context)
Citation Context ...ve overrelaxation (SOR), the modified block unsymmetric SOR, the modified block accelerated overrelaxation (AOR) or the modified block unsymmetric AOR splitting matrix of the matrix W ∈ R n×n in (2.7)=-=[32, 6, 7]-=-; (c) And more generally, the approximation matrix W ∈ R n×n in (2.10) that is generated by any suitable direct or iterative method induced by the matrix W ∈ R n×n in (2.7);s26 Z.-Z. Bai (d) The matri... |

10 |
The numerical solution of equality constrained quadratic programming problems
- Dyn, Ferguson
- 1983
(Show Context)
Citation Context |

8 |
On inexact preconditioners for nonsymmetric matrices
- Bai, Ng
(Show Context)
Citation Context ...tioners[2, 3, 4, 5, 12], block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners =-=[24, 34, 38, 10]-=-, and block triangular preconditioners[35, 37, 10]. Theoretical analyses and experimental results have shown that these preconditioners may lead to nicely clustered eigenvalue distributions of the pre... |

7 | SOR-like methods for augmented systems
- Golub, Wu, et al.
(Show Context)
Citation Context |

6 |
Constrained preconditioning for indefinite linear systems
- Keller, Gould, et al.
- 2000
(Show Context)
Citation Context ...ety of scientific and engineering applications, including computational fluid dynamics[21, 23, 26], mixed finite element approximation of elliptic partial differential equations [16, 38], optimization=-=[25, 30, 34]-=-, optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device[36, 42, 43], structural analysis[44], electrical networks[44], inversion of geoph... |

5 |
Restrictively preconditioned conjugate gradient methods for systems of linear equations
- Bai, Li
(Show Context)
Citation Context ...antities; And thirdly, approximate the matrix W further by another block two-by-two matrix W ∈ R n×n that is also easily invertible. Then, the resulting preconditioners are of the form M = P W Q. See =-=[9, 11]-=-. Let LB, RB ∈ R p×p and LC, RC ∈ R q×q be nonsingular matrices such that or equivalently, L −1 B BR−1 B = JB and L −1 C CR−1 C = JC, (2.1) B = LBJBRB and C = LCJCRC, (2.2) where JB ∈ R p×p is a matri... |

4 |
A class of hybrid algebraic multilevel preconditioning methods
- Bai
(Show Context)
Citation Context ...me special cases of the block two-bytwo matrix A in (1.2). Besides specialized incomplete factorization preconditioners[17, 18] we mention, among others, algebraic multilevel iteration preconditioners=-=[2, 3, 4, 5, 12]-=-, block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners [24, 34, 38, 10], and b... |

3 |
An integral equation method for the electromagnetic scattering from cavities
- Ammari, Bao, et al.
(Show Context)
Citation Context ... θh, 2, −1 − 1 2 θh) ∈ Rq×q is a tridiagonal matrix, Ω = h 2 · diag(ω 2 1 , ω2 2 , . . . , ω2 q) ∈ R q×q is a nonnegative diagonal matrix, G = (gij) ∈ R q×q , and ⊗ denotes the Kronecker product. See =-=[33, 1]-=-. Concretely, in our computations we take θ = 1, ωi = 16π (i = 1, 2, . . . , q), and gij = 1 (i+j) 2 (i, j = 1, 2, . . . , q). Let B ≈ LBRB be an incomplete triangular factorization of the matrix bloc... |

3 |
Restrictive preconditioner for conjugate gradient methods for symmetric positive definite linear system
- Bai, Wang
(Show Context)
Citation Context ...antities; And thirdly, approximate the matrix W further by another block two-by-two matrix W ∈ R n×n that is also easily invertible. Then, the resulting preconditioners are of the form M = P W Q. See =-=[9, 11]-=-. Let LB, RB ∈ R p×p and LC, RC ∈ R q×q be nonsingular matrices such that or equivalently, L −1 B BR−1 B = JB and L −1 C CR−1 C = JC, (2.1) B = LBJBRB and C = LCJCRC, (2.2) where JB ∈ R p×p is a matri... |

2 |
Modified block SSOR preconditioners for symmetric positive definite linear systems
- Bai
(Show Context)
Citation Context ... previously as special cases. Then, with this framework we further present a family of practical and efficient preconditioners by technically combining it with the modified block relaxation iterations=-=[6, 7]-=-, which includes the modified block Jacobi-type, the modified block Gauss-Seidel-type and the modified block unsymmetric (symmetric) Gauss-Seidel-type preconditioners as typical examples. Moreover, we... |

2 |
A 3D rectangular mixed finite element method to solve the stationary semiconductor equations
- Sartoris
(Show Context)
Citation Context ...tion of elliptic partial differential equations [16, 38], optimization[25, 30, 34], optimal control[13], weighted and equality constrained least squares estimation[14], stationary semiconductor device=-=[36, 42, 43]-=-, structural analysis[44], electrical networks[44], inversion of geophysical data[31], and so on. As we have known, preconditioned Krylov subspace methods[40] are efficient iterative solvers for the s... |

2 |
Analysis of iterative methods for saddle point problems: a unified approach
- Zulenher
(Show Context)
Citation Context |

1 |
Parallel Iterative Methods for Large-Scale Systems of Algebraic Equations
- Bai
- 1993
(Show Context)
Citation Context ...me special cases of the block two-bytwo matrix A in (1.2). Besides specialized incomplete factorization preconditioners[17, 18] we mention, among others, algebraic multilevel iteration preconditioners=-=[2, 3, 4, 5, 12]-=-, block and approximate Schur complement preconditioners[21, 23], splitting iteration preconditioners[15, 19, 22, 28, 29, 39, 45], block definite and indefinite preconditioners [24, 34, 38, 10], and b... |

1 |
Parallel hybrid algebraic multilevel iterative methods
- Bai
(Show Context)
Citation Context |

1 |
A class of new hybrid algebraic multilevel preconditioning methods
- Bai, Wang
(Show Context)
Citation Context |

1 |
A parallel block iterative method applied to computations in structural analysis
- Plemmons
(Show Context)
Citation Context |