Convergence Properties of Gradient-Based Methods for Minimax Problems with Nonlinear Constraints
摘要
Minimax optimization plays a crucial role in fields such as adversarial learning, robust optimization, and game theory, where competing objectives must be balanced. However, solving constrained minimax problems introduces considerable difficulties, particularly due to the complexity of the constraints. In this paper, we introduce a gradient-based algorithm that addresses such difficulty by leveraging the augmented Lagrangian method to solve the inner-level problem and efficiently updating the outer variable based on gradient information. By ensuring the Lipschitz continuity of the solution mapping, the algorithm is designed to adapt to various convexity conditions. Specially, for strongly convex objective functions, the algorithm achieves R-linear convergence rate of the objective value. For convex objective functions, the algorithm achieves a local convergence rate of