A limiting analysis on regularization of singular SDP and its implication to infeasible interior-point algorithms

• Published in: Mathematical programming Vol. 200; no. 1; pp. 531 - 568
• Main Authors: Tsuchiya, Takashi, Lourenço, Bruno F., Muramatsu, Masakazu, Okuno, Takayuki
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01-06-2023; Springer Nature B.V
• Subjects: Algorithms; Calculus of Variations and Optimal Control; Optimization; Combinatorics; Constraining; Convergence; Feasibility; Full Length Paper; Mathematical analysis; Mathematical and Computational Physics; Mathematical Methods in Physics; Mathematics; Mathematics and Statistics; Mathematics of Computing; Matrices (mathematics); Numerical Analysis; Perturbation; Regularization; Sequences; Theoretical; 90C31; 90C51; 65K05; Semidefinite programs; 90C25; 90C22; Singular problems; Perturbation; Infeasible interior-point algorithms; Regularization; Nonzero duality gaps
• ISSN: 0025-5610; 1436-4646
• DOI: 10.1007/s10107-022-01891-8

We consider primal-dual pairs of semidefinite programs and assume that they are singular, i.e., both primal and dual are either weakly feasible or weakly infeasible. Under such circumstances, strong duality may break down and the primal and dual might have a nonzero duality gap. Nevertheless, there are arbitrary small perturbations to the problem data which would make them strongly feasible thus zeroing the duality gap. In this paper, we conduct an asymptotic analysis of the optimal value as the perturbation for regularization is driven to zero. Specifically, we fix two positive definite matrices,
I
p
and
I
d
, say, (typically the identity matrices), and regularize the primal and dual problems by shifting their associated affine space by
η
I
p
and
ε
I
d
, respectively, to recover interior feasibility of both problems, where
ε
and
η
are positive numbers. Then we analyze the behavior of the optimal value of the regularized problem when the perturbation is reduced to zero keeping the ratio between
η
and
ε
constant. A key feature of our analysis is that no further assumptions such as compactness or constraint qualifications are ever made. It will be shown that the optimal value of the perturbed problem converges to a value between the primal and dual optimal values of the original problems. Furthermore, the limiting optimal value changes “monotonically” from the primal optimal value to the dual optimal value as a function of
θ
, if we parametrize
(
ε
,
η
)
as
(
ε
,
η
)
=
t
(
cos
θ
,
sin
θ
)
and let
t
→
0
. Finally, the analysis leads us to the relatively surprising consequence that some representative infeasible interior-point algorithms for SDP generate sequences converging to a number between the primal and dual optimal values, even in the presence of a nonzero duality gap. Though this result is more of theoretical interest at this point, it might be of some value in the development of infeasible interior-point algorithms that can handle singular problems.