A proximal partially parallel splitting method for separable convex programs

• Published in: Optimization methods & software Vol. 32; no. 1; pp. 39 - 68
• Main Authors: Wang, Kai, Desai, Jitamitra, He, Hongjin
• Format: Journal Article
• Language: English
• Published: Abingdon Taylor & Francis 02-01-2017; Taylor & Francis Ltd
• Subjects: Algorithms; augmented Lagrangian method; Convergence; convergence rate; Economic models; Efficiency; global convergence; Linear functions; Mathematical analysis; Methods; Operators (mathematics); Optimization; partially parallel splitting algorithm; robust PCA problem; Robustness; separable convex programs; Splitting; Strategy
• ISSN: 1055-6788; 1029-4937
• DOI: 10.1080/10556788.2016.1200044

In this paper, we propose a proximal partially parallel splitting method for solving convex minimization problems, where the objective function is separable into m individual operators without any coupled variables, and the structural constraint set comprises only linear functions. At each iteration of this algorithm, one selected subproblem is solved, and subsequently the remaining subproblems are solved in parallel, utilizing the new iterate information. Hence, the proposed method is a hybrid mechanism that combines the nice features of parallel decomposition methods and alternating direction methods, while simultaneously adopting the predictor-corrector strategy to ensure convergence of the algorithm. Our algorithmic framework is also amenable to admitting linearized versions of the subproblems, which frequently have closed-form solutions, thereby making the proposed method more implementable in practice. Furthermore, the worst-case
convergence rate of the proposed method is obtained under both ergodic and nonergodic conditions. The efficiency of the proposed algorithm is also demonstrated by solving several instances of the robust PCA problem.