“…For example, the Hestenes-Powell-Rockafellar augmented Lagrangian [1][2][3], the cubic augmented Lagrangian [4], Mangasarian's augmented Lagrangian [5,6], the exponential penalty function [7,8], the log-sigmoid Lagrangian [9], modified barrier functions [8,10], the p-th power augmented Lagrangian [11], and nonlinear augmented Lagrangian functions [12][13][14][15]. The other related discussion on augmented Lagrangians regarding special constrained optimization includes second-order cone programming [16,17], semidefinite programming [18][19][20], cone programming [21][22][23], semi-infinite programming [24,25], min-max programming [26], distributed optimization [27], mixed integer programming [28], stochastic mixed-integer programs [29], generalized Nash equilibrium problems [30], quasi-variational inequalities [31], composite convex programming [32], and sparse discrete problems [33]. The duality theory is closely related to the perturbation of primal problem.…”