Testing Heuristics: We Have It All Wrong

Testing Heuristics: We Have It All Wrong (1995)

Cached

Download Links

[www.gsia.cmu.edu]

Other Repositories/Bibliography

CiteULike

by J.N. Hooker

Venue:	Journal of Heuristics
Citations:	105 - 2 self

Versions

Version History

Metadata Version 3

User correction supplied by SystemCorrections

Datum	Value	Source
TITLE	Testing Heuristics: We Have It All Wrong	user correction - Legacy Corrections
AUTHOR NAME	J.N. Hooker	user correction - Legacy Corrections
AUTHOR AFFIL	Graduate School of Industrial Administration; Carnegie Mellon University	user correction - Legacy Corrections
AUTHOR ADDR	Pittsburgh, PA 15213 USA	user correction - Legacy Corrections
ABSTRACT	The competitive nature of most algorithmic experimentation is a source of problems that are all too familiar to the research community. It is hard to make fair comparisons between algorithms and to assemble realistic test problems. Competitive testing tells us which algorithm is faster but not why. Because it requires polished code, it consumes time and energy that could be spent doing more experiments. This paper argues that a more scientific approach of controlled experimentation, similar to that used in other empirical sciences, avoids or alleviates these problems. We have confused research and development; competitive testing is suited only for the latter. Most experimental studies of heuristic algorithms resemble track meets more than scientific endeavors. Typically an investigator has a bright idea for a new algorithm and wants to show that it works better, in some sense, than known algorithms. This requires computational tests, perhaps on a standard set of benchmark p...	user correction - Legacy Corrections
YEAR	1995	INFERENCE
VENUE	Journal of Heuristics	INFERENCE
VENUE TYPE	JOURNAL	INFERENCE
PAGES	33--42	INFERENCE
VOLUME	1	INFERENCE
CITATIONS	16 found	ParsCit 1.0