Results 1 -
1 of
1
Detection And Remediation Of Stagnation In The Nelder-Mead Algorithm Using A Sufficient Decrease Condition
- SIAM J. OPTIM
, 1997
"... The Nelder-Mead algorithm can stagnate and converge to a non-optimal point, even for very simple problems. In this note we propose a test for sufficient decrease which, if passed for the entire iteration, will guarantee convergence of the Nelder-Mead iteration to a stationary point if the objective ..."
Abstract
-
Cited by 21 (1 self)
- Add to MetaCart
The Nelder-Mead algorithm can stagnate and converge to a non-optimal point, even for very simple problems. In this note we propose a test for sufficient decrease which, if passed for the entire iteration, will guarantee convergence of the Nelder-Mead iteration to a stationary point if the objective function is smooth. Failure of this condition is an indicator of potential stagnation. As a remedy we propose a new step, which we call an oriented restart, which reinitializes the simplex to a smaller one with orthogonal edges which contains an approximate steepest descent step from the current best point. We also give results that apply when objective function is a low-amplitude perturbation of a smooth function. We illustrate our results with some numerical examples.

