Block conjugate gradient methods with error norm estimates for least squares problems
摘要
Least squares problems with multiple right-hand sides naturally arise in many practical applications. When the system matrix A is large and sparse, it is often convenient to solve such problems using suitably adapted variants of the block conjugate gradient method (block CGLS) or the block LSQR method. These block methods allow efficient use of modern computational architectures, and the number of iterations needed to achieve the required accuracy is typically much smaller than that required when solving each system separately and successively. However, a known limitation of these block methods is, for some problems, the occurrence of (near) breakdowns caused by (near) rank deficiencies within block vectors. We show how ideas presented in 2001 by A. Dubrulle for block CG can be incorporated into the block CGLS and block LSQR algorithms to avoid numerical instabilities caused by (near) rank deficiencies. For A with a full column rank, this provably prevents breakdowns in block CGLS. For the considered (preconditioned) algorithms, we derive estimates of the