The Importance of Simplicity and Validation in Genetic Programming for Data Mining in Financial Data (1999) [6 citations — 2 self]
http://www.cs.cmu.edu/afs/cs/user/jthomas/Web/Pape
http://www.ri.cmu.edu/pub_files/pub2/thomas_james_
CACHED:
Abstract:
A genetic programming system for data mining trading rules out of past foreign exchange data is described. The system is tested on real data from the dollar/yen and dollar/DM markets, and shown to produce considerable excess returns in the dollar/yen market. Design issues relating to potential rule complexity and validation regimes are explored empirically. Keeping potential rules as simple as possible is shown to be the most important component of success. Validation issues are more complicated. Inspection of fitness on a validation set is used to cut-off search in hopes of avoiding overfitting. Additional attempts to use the validation set to improve performance are shown to be ineffective in the standard framework. An examination of correlations between performance on the validation set and on the test set leads to an understanding of how such measures can be marginally benificial; unfortunately, this suggests that further attemps to improve performance through...
Citations
| 3316 | Neural Networks for Pattern Recognition – Bishop - 1995 |
| 1921 | Genetic Programming I : On the Programming of Computers by Means of Natural Selection – Koza - 1992 |
| 268 | The Econometrics of Financial Markets – Campbell, Lo, et al. - 1997 |
| 90 | Simple Technical Trading Rules and the Stochastic Properties of Stock Returns – Brock, Lakonishok, et al. - 1992 |
| 72 | Using genetic algorithms to find technical trading rules – Allen, Karjalainen - 1999 |
| 54 | Technical analysis in the foreign exchange market: A Layman’s guide. Federal Reserve Bank of St. Louis – Neely - 1997 |
| 25 | Technical trading rule profitability and foreign exchange intervention – LeBaron - 1999 |
| 5 | Using genetic algorithms to nd technical trading rules – Allen, Karjalainen - 1995 |
| 3 | Technical analysis and central bank intervention – Neely, Weller - 1997 |
| 1 | Technical trading rule pro tability and foreign exchange intervention – LeBaron - 1998 |

