This paper presents an overview of the research progress in global optimization during the last 5 years (1998)(1999)(2000)(2001)(2002)(2003), and a brief account of our recent research contributions. The review part covers the areas of (a) twice continuously differentiable nonlinear optimization, (b) mixedinteger nonlinear optimization, (c) optimization with differential-algebraic models, (d) optimization with grey-box/black-box/nonfactorable models, and (e) bilevel nonlinear optimization. Our research contributions part focuses on (i) improved convex underestimation approaches that include convex envelope results for multilinear functions, convex relaxation results for trigonometric functions, and a piecewise quadratic convex underestimator for twice continuously differentiable functions, and (ii) the recently proposed novel generalized ␣BB framework. Computational studies will illustrate the potential of these advances.

No abstract

No abstract

No abstract

The Support Vector Machine (SVM) has been used in a wide variety of classification problems. The original SVM uses the hinge loss function, which is non-differentiable and makes the problem difficult to solve in particular for regularized SVMs, such as with $\ell_1$-regularization. This paper considers the Huberized SVM (HSVM), which uses a differentiable approximation of the hinge loss function. We first explore the use of the Proximal Gradient (PG) method to solving binary-class HSVM (B-HSVM) and then generalize it to multi-class HSVM (M-HSVM). Under strong convexity assumptions, we show that our algorithm converges linearly. In addition, we give a finite convergence result about the support of the solution, based on which we further accelerate the algorithm by a two-stage method. We present extensive numerical experiments on both synthetic and real datasets which demonstrate the superiority of our methods over some state-of-the-art methods for both binary- and multi-class SVMs.Comment: in Pattern analysis and application, 201