Results 1  10
of
20
On Dual Decomposition and Linear Programming Relaxations for Natural Language Processing
 In Proc. EMNLP
, 2010
"... This paper introduces dual decomposition as a framework for deriving inference algorithms for NLP problems. The approach relies on standard dynamicprogramming algorithms as oracle solvers for subproblems, together with a simple method for forcing agreement between the different oracles. The approa ..."
Abstract

Cited by 73 (3 self)
 Add to MetaCart
This paper introduces dual decomposition as a framework for deriving inference algorithms for NLP problems. The approach relies on standard dynamicprogramming algorithms as oracle solvers for subproblems, together with a simple method for forcing agreement between the different oracles. The approach provably solves a linear programming (LP) relaxation of the global inference problem. It leads to algorithms that are simple, in that they use existing decoding algorithms; efficient, in that they avoid exact algorithms for the full model; and often exact, in that empirically they often recover the correct solution in spite of using an LP relaxation. We give experimental results on two problems: 1) the combination of two lexicalized parsing models; and 2) the combination of a lexicalized parsing model and a trigram partofspeech tagger. 1
The Steiner tree polytope and related polyhedra
, 1994
"... We consider the vertexweighted version of the undirected Steiner tree problem. In this problem, a cost is incurred both for the vertices and the edges present in the Steiner tree. We completely describe the associated polytope by linear inequalities when the underlying graph is seriesparallel. For ..."
Abstract

Cited by 30 (1 self)
 Add to MetaCart
We consider the vertexweighted version of the undirected Steiner tree problem. In this problem, a cost is incurred both for the vertices and the edges present in the Steiner tree. We completely describe the associated polytope by linear inequalities when the underlying graph is seriesparallel. For general graphs, this formulation can be interpreted as a (partial) extended formulation for the Steiner tree problem. By projecting this formulation, we obtain some very large classes of facetdefining valid inequalities for the Steiner tree polytope.
A Catalog of Steiner Tree Formulations
, 1993
"... We present some existing and some new formulations for the Steiner tree and Steiner arborescence problems. We show the equivalence of many of these formulations. In particular, we establish the equivalence between the classical bidirected dicut relaxation and two vertex weighted undirected relaxatio ..."
Abstract

Cited by 29 (0 self)
 Add to MetaCart
(Show Context)
We present some existing and some new formulations for the Steiner tree and Steiner arborescence problems. We show the equivalence of many of these formulations. In particular, we establish the equivalence between the classical bidirected dicut relaxation and two vertex weighted undirected relaxations. The motivation behind this study is a characterization of the feasible region of the dicut relaxation in the natural space corresponding to the Steiner tree problem.
A Tutorial on Dual Decomposition and Lagrangian Relaxation for Inference in Natural Language Processing
"... Dual decomposition, and more generally Lagrangian relaxation, is a classical method for combinatorial optimization; it has recently been applied to several inference problems in natural language processing (NLP). This tutorial gives an overview of the technique. We describe example algorithms, descr ..."
Abstract

Cited by 22 (4 self)
 Add to MetaCart
Dual decomposition, and more generally Lagrangian relaxation, is a classical method for combinatorial optimization; it has recently been applied to several inference problems in natural language processing (NLP). This tutorial gives an overview of the technique. We describe example algorithms, describe formal guarantees for the method, and describe practical issues in implementing the algorithms. While our examples are predominantly drawn from the NLP literature, the material should be of general relevance to inference problems in machine learning. A central theme of this tutorial is that Lagrangian relaxation is naturally applied in conjunction with a broad class of combinatorial algorithms, allowing inference in models that go significantly beyond previous work on Lagrangian relaxation for inference in graphical models.
Extended formulations in combinatorial optimization
 Optima
"... The concept of representing a polytope that is associated with some combinatorial optimization problem as a linear projection of a higherdimensional polyhedron has recently received increasing attention. In this paper (written for the newsletter Optima of the Mathematical Optimization Society), we ..."
Abstract

Cited by 17 (2 self)
 Add to MetaCart
(Show Context)
The concept of representing a polytope that is associated with some combinatorial optimization problem as a linear projection of a higherdimensional polyhedron has recently received increasing attention. In this paper (written for the newsletter Optima of the Mathematical Optimization Society), we provide a brief introduction to this topic and sketch some of the recent developments with respect to both tools for constructing such extended formulations as well as lower bounds on their sizes. 1
Exact Decoding of Syntactic Translation Models through Lagrangian Relaxation
, 2011
"... We describe an exact decoding algorithm for syntaxbased statistical translation. The approach uses Lagrangian relaxation to decompose the decoding problem into tractable subproblems, thereby avoiding exhaustive dynamic programming. The method recovers exact solutions, with certificates of optimalit ..."
Abstract

Cited by 14 (3 self)
 Add to MetaCart
(Show Context)
We describe an exact decoding algorithm for syntaxbased statistical translation. The approach uses Lagrangian relaxation to decompose the decoding problem into tractable subproblems, thereby avoiding exhaustive dynamic programming. The method recovers exact solutions, with certificates of optimality, on over 97 % of test examples; it has comparable speed to stateoftheart decoders.
Extended Formulations for Packing and Partitioning Orbitopes
, 2008
"... We give compact extended formulations for the packing and partitioning orbitopes (with respect to the full symmetric group) described and analyzed in [6]. These polytopes are the convex hulls of all 0/1matrices with lexicographically sorted columns and at most, resp. exactly, one 1entry per row. ..."
Abstract

Cited by 9 (2 self)
 Add to MetaCart
(Show Context)
We give compact extended formulations for the packing and partitioning orbitopes (with respect to the full symmetric group) described and analyzed in [6]. These polytopes are the convex hulls of all 0/1matrices with lexicographically sorted columns and at most, resp. exactly, one 1entry per row. They are important objects for symmetry reduction in certain integer programs. Using the extended formulations, we also derive a rather simple proof of the fact [6] that basically shiftedcolumn inequalities suffice in order to describe those orbitopes linearly.
POLYHEDRAL COMBINATORICS
"... Polyhedral combinatorics is a rich mathematical subject motivated by integer and linear programming. While not exhaustive, this survey covers a variety of interesting topics, so let’s get right to it! ..."
Abstract

Cited by 5 (0 self)
 Add to MetaCart
Polyhedral combinatorics is a rich mathematical subject motivated by integer and linear programming. While not exhaustive, this survey covers a variety of interesting topics, so let’s get right to it!
Constant Integrality Gap LP Formulations of Unsplittable Flow on a Path
, 2013
"... The Unsplittable Flow Problem on a Path (UFPP) isacore problem in many important settings such as network flows, bandwidth allocation, resource constraint scheduling, and interval packing. We are given a path with capacities on the edges and a set of tasks, each task having a demand, a profit, a sou ..."
Abstract

Cited by 4 (3 self)
 Add to MetaCart
(Show Context)
The Unsplittable Flow Problem on a Path (UFPP) isacore problem in many important settings such as network flows, bandwidth allocation, resource constraint scheduling, and interval packing. We are given a path with capacities on the edges and a set of tasks, each task having a demand, a profit, a source and a destination vertex on the path. The goal is to compute a subset of tasks of maximum profit that does not violate the edge capacities. In practical applications generic approaches such as integer programming (IP) methods are desirable. Unfortunately, no IPformulation is known for the problem whose LPrelaxation has an integrality gap that is provably constant. For the unweighted case, we show that adding a few constraints to the standard LP of the problem is sufficient to make the integrality gap drop from Ω(n) to O(1). This positively answers an open question in [Chekuri et al., APPROX 2009]. For the general (weighted) case, we present an extended formulation with integrality gap bounded by 7+ε. This matches the best known approximation factor for the problem [Bonsma et al., FOCS 2011]. This result exploits crucially a technique for embedding dynamic programs into linear programs. We believe that this method could be useful to strengthen LPformulations for other problems as well and might eventually speed up computations due to stronger problem formulations.