Results 1  10
of
94
Interior Point Methods in Semidefinite Programming with Applications to Combinatorial Optimization
 SIAM Journal on Optimization
, 1993
"... We study the semidefinite programming problem (SDP), i.e the problem of optimization of a linear function of a symmetric matrix subject to linear equality constraints and the additional condition that the matrix be positive semidefinite. First we review the classical cone duality as specialized to S ..."
Abstract

Cited by 499 (12 self)
 Add to MetaCart
We study the semidefinite programming problem (SDP), i.e the problem of optimization of a linear function of a symmetric matrix subject to linear equality constraints and the additional condition that the matrix be positive semidefinite. First we review the classical cone duality as specialized to SDP. Next we present an interior point algorithm which converges to the optimal solution in polynomial time. The approach is a direct extension of Ye's projective method for linear programming. We also argue that most known interior point methods for linear programs can be transformed in a mechanical way to algorithms for SDP with proofs of convergence and polynomial time complexity also carrying over in a similar fashion. Finally we study the significance of these results in a variety of combinatorial optimization problems including the general 01 integer programs, the maximum clique and maximum stable set problems in perfect graphs, the maximum k partite subgraph problem in graphs, and va...
An InteriorPoint Method for Semidefinite Programming
, 2005
"... We propose a new interior point based method to minimize a linear function of a matrix variable subject to linear equality and inequality constraints over the set of positive semidefinite matrices. We show that the approach is very efficient for graph bisection problems, such as maxcut. Other appli ..."
Abstract

Cited by 219 (18 self)
 Add to MetaCart
(Show Context)
We propose a new interior point based method to minimize a linear function of a matrix variable subject to linear equality and inequality constraints over the set of positive semidefinite matrices. We show that the approach is very efficient for graph bisection problems, such as maxcut. Other applications include maxmin eigenvalue problems and relaxations for the stable set problem.
An interiorpoint method for largescale l1regularized logistic regression
 Journal of Machine Learning Research
, 2007
"... Logistic regression with ℓ1 regularization has been proposed as a promising method for feature selection in classification problems. In this paper we describe an efficient interiorpoint method for solving largescale ℓ1regularized logistic regression problems. Small problems with up to a thousand ..."
Abstract

Cited by 167 (5 self)
 Add to MetaCart
(Show Context)
Logistic regression with ℓ1 regularization has been proposed as a promising method for feature selection in classification problems. In this paper we describe an efficient interiorpoint method for solving largescale ℓ1regularized logistic regression problems. Small problems with up to a thousand or so features and examples can be solved in seconds on a PC; medium sized problems, with tens of thousands of features and examples, can be solved in tens of seconds (assuming some sparsity in the data). A variation on the basic method, that uses a preconditioned conjugate gradient method to compute the search step, can solve very large problems, with a million features and examples (e.g., the 20 Newsgroups data set), in a few minutes, on a PC. Using warmstart techniques, a good approximation of the entire regularization path can be computed much more efficiently than by solving a family of problems independently.
PrimalDual PathFollowing Algorithms for Semidefinite Programming
 SIAM Journal on Optimization
, 1996
"... This paper deals with a class of primaldual interiorpoint algorithms for semidefinite programming (SDP) which was recently introduced by Kojima, Shindoh and Hara [11]. These authors proposed a family of primaldual search directions that generalizes the one used in algorithms for linear programmin ..."
Abstract

Cited by 151 (10 self)
 Add to MetaCart
(Show Context)
This paper deals with a class of primaldual interiorpoint algorithms for semidefinite programming (SDP) which was recently introduced by Kojima, Shindoh and Hara [11]. These authors proposed a family of primaldual search directions that generalizes the one used in algorithms for linear programming based on the scaling matrix X 1=2 S \Gamma1=2 . They study three primaldual algorithms based on this family of search directions: a shortstep pathfollowing method, a feasible potentialreduction method and an infeasible potentialreduction method. However, they were not able to provide an algorithm which generalizes the longstep pathfollowing algorithm introduced by Kojima, Mizuno and Yoshise [10]. In this paper, we characterize two search directions within their family as being (unique) solutions of systems of linear equations in symmetric variables. Based on this characterization, we present: 1) a simplified polynomial convergence proof for one of their shortstep pathfollowing ...
A Spectral Bundle Method for Semidefinite Programming
 SIAM JOURNAL ON OPTIMIZATION
, 1997
"... A central drawback of primaldual interior point methods for semidefinite programs is their lack of ability to exploit problem structure in cost and coefficient matrices. This restricts applicability to problems of small dimension. Typically semidefinite relaxations arising in combinatorial applica ..."
Abstract

Cited by 147 (7 self)
 Add to MetaCart
(Show Context)
A central drawback of primaldual interior point methods for semidefinite programs is their lack of ability to exploit problem structure in cost and coefficient matrices. This restricts applicability to problems of small dimension. Typically semidefinite relaxations arising in combinatorial applications have sparse and well structured cost and coefficient matrices of huge order. We present a method that allows to compute acceptable approximations to the optimal solution of large problems within reasonable time. Semidefinite programming problems with constant trace on the primal feasible set are equivalent to eigenvalue optimization problems. These are convex nonsmooth programming problems and can be solved by bundle methods. We propose replacing the traditional polyhedral cutting plane model constructed from subgradient information by a semidefinite model that is tailored for eigenvalue problems. Convergence follows from the traditional approach but a proof is included for completene...
Robust Constrained Model Predictive Control using Linear Matrix Inequalities
, 1996
"... The primary disadvantage of current design techniques for model predictive control (MPC) is their inability to deal explicitly with plant model uncertainty. In this paper, we present a new approach for robust MPC synthesis which allows explicit incorporation of the description of plant uncertainty i ..."
Abstract

Cited by 109 (5 self)
 Add to MetaCart
The primary disadvantage of current design techniques for model predictive control (MPC) is their inability to deal explicitly with plant model uncertainty. In this paper, we present a new approach for robust MPC synthesis which allows explicit incorporation of the description of plant uncertainty in the problem formulation. The uncertainty is expressed both in the time domain and the frequency domain. The goal is to design, at each time step, a statefeedback control law which minimizes a "worstcase" infinite horizon objective function, subject to constraints on the control input and plant output. Using standard techniques, the problem of minimizing an upper bound on the "worstcase" objective function, subject to input and output constraints, is reduced to a convex optimization involving linear matrix inequalities (LMIs). It is shown that the feasible receding horizon statefeedback control design robustly stabilizes the set of uncertain plants under consideration. Several extensions...
Advanced gainscheduling techniques for uncertain systems
 IEEE Trans. on Control System Technology
, 1998
"... ..."
Semidefinite Programming Relaxations For The Quadratic Assignment Problem
, 1998
"... Semidefinite programming (SDP) relaxations for the quadratic assignment problem (QAP) are derived using the dual of the (homogenized) Lagrangian dual of appropriate equivalent representations of QAP. These relaxations result in the interesting, special, case where only the dual problem of the SDP re ..."
Abstract

Cited by 72 (25 self)
 Add to MetaCart
Semidefinite programming (SDP) relaxations for the quadratic assignment problem (QAP) are derived using the dual of the (homogenized) Lagrangian dual of appropriate equivalent representations of QAP. These relaxations result in the interesting, special, case where only the dual problem of the SDP relaxation has strict interior, i.e. the Slater constraint qualification always fails for the primal problem. Although there is no duality gap in theory, this indicates that the relaxation cannot be solved in a numerically stable way. By exploring the geometrical structure of the relaxation, we are able to find projected SDP relaxations. These new relaxations, and their duals, satisfy the Slater constraint qualification, and so can be solved numerically using primaldual interiorpoint methods. For one of our models, a preconditioned conjugate gradient method is used for solving the large linear systems which arise when finding the Newton direction. The preconditioner is found by exploiting th...
On Extending Some PrimalDual InteriorPoint Algorithms From Linear Programming to Semidefinite Programming
 SIAM Journal on Optimization
, 1998
"... This work concerns primaldual interiorpoint methods for semidefinite programming (SDP) that use a search direction originally proposed by HelmbergRendlVanderbeiWolkowicz [5] and KojimaShindohHara [11], and recently rediscovered by Monteiro [15] in a more explicit form. In analyzing these meth ..."
Abstract

Cited by 65 (1 self)
 Add to MetaCart
(Show Context)
This work concerns primaldual interiorpoint methods for semidefinite programming (SDP) that use a search direction originally proposed by HelmbergRendlVanderbeiWolkowicz [5] and KojimaShindohHara [11], and recently rediscovered by Monteiro [15] in a more explicit form. In analyzing these methods, a number of basic equalities and inequalities were developed in [11] and also in [15] through different means and in different forms. In this paper, we give a concise derivation of the key equalities and inequalities for complexity analysis along the exact line used in linear programming (LP), producing basic relationships that have compact forms almost identical to their counterparts in LP. We also introduce a new formulation of the central path and variablemetric measures of centrality. These results provide convenient tools for deriving polynomiality results for primaldual algorithms extended from LP to SDP using the aforementioned and related search directions. We present examples...