Multicategory ψ-Learning and Support Vector Machine: Computational Tools

Abstract

Many margin-based binary classification techniques such as support vector machine (SVM) and ψ-learning deliver high performance. An earlier article proposed a new multicategory ψ-learning methodology that shows great promise in generalization ability. However,ψ-learning is computationally difficult because it requires handling a nonconvex minimization problem. In this article, we propose two computational tools for multicategory ψ-learning. The first one is based on d.c. algorithms and solved by sequential quadratic programming, while the second one uses the outer approximation method, which yields the global minimizer via sequential concave minimization. Numerical examples show the proposed algorithms perform well.

Key Words:

• Classification
• Concave minimization
• d.c. algorithms
• Nonconvex minimization
• Outer approximation
• Quadratic programming