Abstract

The problem of minimizing the number of misclassified points by a plane, attempting to separate two point sets with intersecting convex hulls in n-dimensional real space, is formulated as a linear program with equilibrium constraints (LPEC). This general LPEC can be converted to an exact penalty problem with a quadratic objective and linear constraints. A Frank-Wolfe-type algorithm is proposed for the penalty problem that terminates at a stationary point or a global solution. Novel aspects of the approach include: (i) A linear complementarity formulation of the step function that "counts" misclassifications, (ii) Exact penalty formulation without boundedness, nondegeneracy or constraint qualification assumptions, (iii) An exact solution extraction from the sequence of minimizers of the penalty function for a finite value of the penalty parameter for the general LPEC and an explicitly exact solution for the LPEC with uncoupled constraints, and (iv) A parametric quadratic programming form...

Citations

3341	Pattern Classification and Scene Analysis - Duda, Hart - 1973
1530	Introduction to the Theory of Neural Computation - Hertz, Krogh, et al. - 1991
763	Numerical Methods for Unconstrained Optimization and Nonlinear Equations - Dennis - 1983
184	Robust linear programming discrimination of two linearly inseparable sets - Bennett, Mangasarian - 1992
155	Nonlinear programming - Mangasarian - 1969
126	An algorithm for quadratic programming - Frank, Wolfe - 1956
113	Multisurface method of pattern separation for medical diagnosis applied to breast cytology - Wolberg, Mangasarian - 1990
64	Pattern recognition via linear programming: Theory and Applications to medical diagnosis - Mangasarian, Setiono, et al. - 1990
54	OC1: Randomized Induction of Oblique Decision Trees - Murthy, Kasif, et al. - 1993
42	The perceptron: A perceiving and recognizing automaton - Rosenblatt - 1957
36	Neural network training via linear programming - Bennett, Mangasarian - 1992
32	Bilinear separation of two sets in n-space - Bennett, Mangasarian - 1993
23	Exact penalization and stationarity conditions of mathematical programs with equilibrium constraints - Luo, Pang, et al. - 1993
23	Characterization of linear complementarity problems as linear programs - Mangasarian - 1978
12	On the existence of optimal solutions to mathematical program with equilibrium constraints - Harker, Pang - 1988
12	and nonlinear separation of patterns by linear programming - Linear - 1965
11	Programming, Games and Transportation Networks - Berge, Ghouila–Houri - 1965
10	A solution method for the linear static stackelberg problem using penalty funcitons - Anandalingam, White - 1990
9	Hierarchical optimization: An introduction - Anandalingam, Friesz - 1992
5	On the Boundedness of an Iterative Procedure for Solving a System of Linear Inequalities - Block, Levin - 1970
5	Some applications of penalty functions in mathematical programming - Mangasarian - 1986