Inertial randomized Kaczmarz algorithms for solving coherent linear systems

In this paper, by regarding the two-subspace Kaczmarz method as an alternated inertial randomized Kaczmarz algorithm we present a better convergence rate estimate under a mild condition. Furthermore, we accelerate the alternated inertial randomized Kaczmarz algorithm and introduce a multi-step inertial randomized Kaczmarz algorithm which is proved to have a faster convergence rate. Numerical experiments support the theory results and illustrate that the multi-inertial randomized Kaczmarz algorithm significantly outperform the two-subspace Kaczmarz method in solving coherent linear systems.