## epsilon-Transformation: Exploiting Phase Transitions to Solve Combinatorial Optimization Problems (1994)

Venue: | Artificial Intelligence |

Citations: | 12 - 3 self |

### BibTeX

@ARTICLE{Zhang94epsilon-transformation:exploiting,

author = {Weixiong Zhang and Joseph C. Pemberton},

title = {epsilon-Transformation: Exploiting Phase Transitions to Solve Combinatorial Optimization Problems},

journal = {Artificial Intelligence},

year = {1994},

volume = {81},

pages = {297--325}

}

### Years of Citing Articles

### OpenURL

### Abstract

It has been shown that there exists a transition in the averagecase complexity of tree search problems, from exponential to polynomial in the search depth. We develop a new method, called ffl- transformation, which makes use of this complexity transition, to find a suboptimal solution. With a random tree model, we show that the expected number of nodes expanded by branch-and-bound (BnB) using ffl-transformation is at most cubic in the search depth, and that the error of the solution cost found relative to the optimal solution cost is a small constant. We also present an iterative version of ffl-transformation that can be used to find both optimal and suboptimal goal nodes. Depth-first BnB (DFBnB) using iterative ffl-transformation significantly improves upon truncated DFBnB on random trees with large branching factors and deep goal nodes, finding better solutions sooner on average. Our experiments on the asymmetric traveling salesman problem show that DFBnB using ffl- transformati...

### Citations

10921 |
Computers and Intractability: A Guide to the Theory of NP-Completeness
- Garey, Johnson
(Show Context)
Citation Context ...vement over truncated DFBnB is less, as seen by comparing Figure 5(b) to Figure 4(b). 6.2 The Asymmetric Traveling Salesman Problem The asymmetric traveling salesman problem (ATSP) [19] is an NP-hard =-=[7]-=- combinatorial problem. Given n cities and an asymmetric matrix (c i;j ) that 12 defines a cost between each pair of cities, the ATSP is to find a minimumcost tour that visits each city exactly once a... |

1271 |
Combinatorial Optimization: Algorithms and Complexity
- Papadimitriou, Steiglitz
- 1982
(Show Context)
Citation Context ... as the traveling salesman problem [33, 34]. Best-first search (BFS) and depth-first branch-and-bound (DFBnB) can be used to search these random trees. Both are special cases of branch-andbound (BnB) =-=[17, 20, 26]-=-, which is a general technique for problem solving. BFS maintains a partially expanded state space, and at each cycle expands a minimum-cost node among all those generated but not yet expanded, until ... |

577 | Where the really hard problems are
- Cheeseman, Kanefsky, et al.
- 1991
(Show Context)
Citation Context ... a UCLA Chancellor's Dissertation Year Fellowship (1993-94). 1 1 Introduction It has been observed that phase transitions exist in many intelligent systems [9] and combinatorial optimization problems =-=[3, 4, 15, 18, 22, 23, 24, 31, 33, 34]-=-. A phase transition is a dramatic change to some problem property as some order parameter changes across a critical point. The simplest phase transition example is that water changes from a solid pha... |

322 |
An effective heuristic algorithm for the traveling salesman problem
- Lin, Kernighan
- 1973
(Show Context)
Citation Context ...s is that the territory explored by iterative ffl-DFBnB is generally smaller than the territory explored by truncated DFBnB, although iterative ffl-DFBnB may re-expand a node many times. Local search =-=[12, 13, 21]-=- is a well-known approximation method for many difficult combinatorial problems. Starting at an initial solution, such as one generated by a polynomial-time approximation algorithm, local search conti... |

313 |
The Traveling Salesman Problem
- Lawler
- 1985
(Show Context)
Citation Context ...nsformation for finding both suboptimal and optimal goal nodes (Section 5). We identify the conditions when both methods are effective on random trees and on the asymmetric traveling salesman problem =-=[19]-=- (Section 6). Related work is discussed in Section 7, and our conclusions appear in Section 8. 2 ffl-Transformation ffl-transformation is based on the following very simple observation of Figure 1(b).... |

283 |
and easy distributions of sat problems
- Hard
- 1992
(Show Context)
Citation Context ... a UCLA Chancellor's Dissertation Year Fellowship (1993-94). 1 1 Introduction It has been observed that phase transitions exist in many intelligent systems [9] and combinatorial optimization problems =-=[3, 4, 15, 18, 22, 23, 24, 31, 33, 34]-=-. A phase transition is a dramatic change to some problem property as some order parameter changes across a critical point. The simplest phase transition example is that water changes from a solid pha... |

217 |
Probability Theory
- Rényi
- 1970
(Show Context)
Citation Context ...and consider an improvement and a variation (Section 4). We also present an 1 A sequence Xn of random variables is said to converge almost surely (with probability one) to X if P (lim n!1 Xn = X) = 1 =-=[30]-=-. 3 0.0 0.2 0.4 0.6 0.8 1.0 0 5 10 15 20 branching factor b p = prob. of zero-cost edges 0 transition boundary bp = 1 0 0.0 0.2 0.4 0.6 0.8 1.0 0 5 10 15 20 branching factor b p = prob. of zero-cost e... |

201 | Experimental results on the cross-over point in satisfiability problems
- Crawford, Auton
- 1993
(Show Context)
Citation Context ... a UCLA Chancellor's Dissertation Year Fellowship (1993-94). 1 1 Introduction It has been observed that phase transitions exist in many intelligent systems [9] and combinatorial optimization problems =-=[3, 4, 15, 18, 22, 23, 24, 31, 33, 34]-=-. A phase transition is a dramatic change to some problem property as some order parameter changes across a critical point. The simplest phase transition example is that water changes from a solid pha... |

174 | Performance measurement and analysis of certain search algorithms
- Gaschnig
- 1979
(Show Context)
Citation Context ...of the edge costs along the path from the root to that node. An optimal goal node is a node of minimum cost at depth d. Compared to the conventional tree model that assumes independence of node costs =-=[8, 27, 28]-=-, this random tree is more realistic because it naturally introduces dependences among node costs. The costs of two nodes are dependent on each other if they share common edges on their paths to the r... |

161 | Generalized best-first search strategies and the optimality of a
- Dechter, Pearl
- 1985
(Show Context)
Citation Context ... expanded, until an optimal goal node is chosen for expansion. BFS is optimal among all algorithms that are guaranteed to find an optimal goal node, and use the same cost function, up to tie-breaking =-=[5]-=-. Hence, the complexity of BFS is also the complexity of finding an optimal goal node. DFBnB uses an upper bound u on the cost of an optimal goal. Starting at the root node, it chooses a deepest node,... |

147 |
Local optimization and the traveling salesman problem
- Johnson
- 1990
(Show Context)
Citation Context ...s is that the territory explored by iterative ffl-DFBnB is generally smaller than the territory explored by truncated DFBnB, although iterative ffl-DFBnB may re-expand a node many times. Local search =-=[12, 13, 21]-=- is a well-known approximation method for many difficult combinatorial problems. Starting at an initial solution, such as one generated by a polynomial-time approximation algorithm, local search conti... |

140 |
Branch-and-Bound Methods: A Survey
- Lawler, Wood
- 1966
(Show Context)
Citation Context ... as the traveling salesman problem [33, 34]. Best-first search (BFS) and depth-first branch-and-bound (DFBnB) can be used to search these random trees. Both are special cases of branch-andbound (BnB) =-=[17, 20, 26]-=-, which is a general technique for problem solving. BFS maintains a partially expanded state space, and at each cycle expands a minimum-cost node among all those generated but not yet expanded, until ... |

74 |
On the worst-case performance of some algorithms for the asymmetric traveling salesman problem
- Frieze, Galbiati, et al.
- 1982
(Show Context)
Citation Context ...ed ffl -DFBnB with a local search method [25] which was applied five different times for each problem instance in our experiments. The five initial tours were generated by the nearest-neighbor method =-=[6]-=-, nearest insertion farthest insertion, greedy algorithms, and the patching algorithm [6, 14]. We used random cost matrices and matrices converted from no-wait flowshop scheduling for 4 machines, whic... |

46 | Evidence for a Satisfiability Threshold for Random 3CNF Formulas
- Larrabee, Tsuji
- 1992
(Show Context)
Citation Context |

45 |
A Patching Algorithm For the Nonsymmetric Traveling-Salesman Problem
- KARP
- 1979
(Show Context)
Citation Context ...each problem instance in our experiments. The five initial tours were generated by the nearest-neighbor method [6], nearest insertion farthest insertion, greedy algorithms, and the patching algorithm =-=[6, 14]-=-. We used random cost matrices and matrices converted from no-wait flowshop scheduling for 4 machines, which is NP-hard [13]. No-wait flowshop scheduling involves determining a sequence for processing... |

37 |
Searching for an optimal path in a tree with random costs
- Karp, Pearl
- 1987
(Show Context)
Citation Context |

33 |
Branch and Bound Methods
- Balas, Toth
- 1985
(Show Context)
Citation Context ...nd returns to the starting city. The ATSP can be optimally solved by branch-and-bound (BnB), using the solution cost of the related assignment problem (AP) [26] as a monotonic node cost function. See =-=[2]-=- for a summary and detailed description of the method. Briefly, the state space of the ATSP under BnB is a tree without duplicate nodes. In our implementation of ffl-DFBnB and iterative fflDFBnB, we u... |

31 |
Phase transitions in artificial intelligence systems
- Huberman, Hogg
- 1987
(Show Context)
Citation Context ...al, a GTE graduate fellowship (1992-93), and a UCLA Chancellor's Dissertation Year Fellowship (1993-94). 1 1 Introduction It has been observed that phase transitions exist in many intelligent systems =-=[9]-=- and combinatorial optimization problems [3, 4, 15, 18, 22, 23, 24, 31, 33, 34]. A phase transition is a dramatic change to some problem property as some order parameter changes across a critical poin... |

26 |
Local search for the asymmetric traveling salesman problem
- Kanellakis, Papadimitriou
- 1980
(Show Context)
Citation Context ...s is that the territory explored by iterative ffl-DFBnB is generally smaller than the territory explored by truncated DFBnB, although iterative ffl-DFBnB may re-expand a node many times. Local search =-=[12, 13, 21]-=- is a well-known approximation method for many difficult combinatorial problems. Starting at an initial solution, such as one generated by a polynomial-time approximation algorithm, local search conti... |

26 |
Practical and Theoretical Considerations in Heuristic Search Algorithn_s
- Pohl
- 1977
(Show Context)
Citation Context ...of the edge costs along the path from the root to that node. An optimal goal node is a node of minimum cost at depth d. Compared to the conventional tree model that assumes independence of node costs =-=[8, 27, 28]-=-, this random tree is more realistic because it naturally introduces dependences among node costs. The costs of two nodes are dependent on each other if they share common edges on their paths to the r... |

19 |
Enumerative approaches to combinatorial optimization
- Ibaraki
- 1988
(Show Context)
Citation Context ...nt as an approximation. This method was also referred to as truncated DFBnB, which we adopted in this paper. The earliest study of this method that we found was made by Ashour [1, 16]. Ibaraki et al. =-=[10, 11]-=- systematically studied approximation methods based on BnB, which they called suboptimal BnB algorithms. Their experimental results indicate that a good cost function is crucial to realize a successfu... |

18 |
On the flow-shop sequencing problem with no wait in process, Operational Research Quarterly 23
- Reddi, Ramamoorthy
- 1972
(Show Context)
Citation Context ...nstances were generated by uniformly choosing the processing time of a job on a machine from f0; 1; 2; \Delta \Delta \Delta ; 2 16 \Gamma 1g. We then converted them into the ATSPs using the method in =-=[29]-=-. The average running time of local search is much longer than that of ffl - 13 % error relative to AP cost time (sec.) 0.165 0.170 0.175 0.180 0.185 0.190 0.195 0.200 0.205 0 200 400 600 16 500-city ... |

17 |
Extending Deep Structure
- Williams, Hogg
- 1993
(Show Context)
Citation Context |

16 | Flowshop scheduling with limited temporary storage
- Papadimitriou, Kanellakis
- 1980
(Show Context)
Citation Context ...error of tour costs from these two algorithms relative to the AP lower bounds. This result is similar to the result on random trees in Figure 4. We also compared ffl -DFBnB with a local search method =-=[25]-=- which was applied five different times for each problem instance in our experiments. The five initial tours were generated by the nearest-neighbor method [6], nearest insertion farthest insertion, gr... |

16 |
Truncated branch-and-bound: A case study on the asymmetric TSP
- Zhang
- 1993
(Show Context)
Citation Context ...tive ffl-transformation are effective. To this end, we compare fflDFBnB and iterative ffl-DFBnB with other approximation algorithms. Iterative ffl-DFBnB can be used in the same way as truncated DFBnB =-=[11, 32]-=- to find approximate and optimal solutions. Truncated DFBnB is a DFBnB that terminates prematurely when the total available computation has been exhausted. The best solution found up to that point can... |

10 |
Enumerative and Iterative Computational Approaches
- Kohler, Steiglitz
- 1976
(Show Context)
Citation Context ...lution found to that point as an approximation. This method was also referred to as truncated DFBnB, which we adopted in this paper. The earliest study of this method that we found was made by Ashour =-=[1, 16]-=-. Ibaraki et al. [10, 11] systematically studied approximation methods based on BnB, which they called suboptimal BnB algorithms. Their experimental results indicate that a good cost function is cruci... |

10 |
An average-case analysis of branch-and-bound with applications: Summary of results
- Zhang, Korf
- 1992
(Show Context)
Citation Context |

9 | An expected-cost analysis of backtracking and non-bactracking algorithms
- McDiarmid, Provan
- 1991
(Show Context)
Citation Context ...nd Pearl [15] also proposed an algorithm that finds a suboptimal goal node of a tree most of the time, but may fail sometimes, and runs in expected time linear in the tree depth. McDiarmid and Provan =-=[22, 23]-=- extended Karp and Pearl's approximation algorithm to a general random tree. They further introduced dead-end nodes, which are leaf nodes located at a shallower depth than optimal goal nodes. They sho... |

6 | Depth-first vs. best-first search: New results - Zhang, Korf - 1993 |

5 |
Using branch-and-bound algorithms to obtain suboptimal solutions
- Ibaraki, Muro, et al.
- 1983
(Show Context)
Citation Context ...tive ffl-transformation are effective. To this end, we compare fflDFBnB and iterative ffl-DFBnB with other approximation algorithms. Iterative ffl-DFBnB can be used in the same way as truncated DFBnB =-=[11, 32]-=- to find approximate and optimal solutions. Truncated DFBnB is a DFBnB that terminates prematurely when the total available computation has been exhausted. The best solution found up to that point can... |

3 |
Search branch-and-bound
- Kumar
- 1992
(Show Context)
Citation Context ... as the traveling salesman problem [33, 34]. Best-first search (BFS) and depth-first branch-and-bound (DFBnB) can be used to search these random trees. Both are special cases of branch-andbound (BnB) =-=[17, 20, 26]-=-, which is a general technique for problem solving. BFS maintains a partially expanded state space, and at each cycle expands a minimum-cost node among all those generated but not yet expanded, until ... |

1 |
An experimental investigation and comparative evaluation of flow-shop scheduling techniques
- Ashour
- 1970
(Show Context)
Citation Context ...lution found to that point as an approximation. This method was also referred to as truncated DFBnB, which we adopted in this paper. The earliest study of this method that we found was made by Ashour =-=[1, 16]-=-. Ibaraki et al. [10, 11] systematically studied approximation methods based on BnB, which they called suboptimal BnB algorithms. Their experimental results indicate that a good cost function is cruci... |

1 |
Probabilistic analysis of tree searchdisorder
- McDiarmid
- 1990
(Show Context)
Citation Context |