On Automatic Differentiation (1989)
| Venue: | IN MATHEMATICAL PROGRAMMING: RECENT DEVELOPMENTS AND APPLICATIONS |
| Citations: | 121 - 14 self |
BibTeX
@INPROCEEDINGS{Griewank89onautomatic,
author = {Andreas Griewank},
title = {On Automatic Differentiation},
booktitle = {IN MATHEMATICAL PROGRAMMING: RECENT DEVELOPMENTS AND APPLICATIONS},
year = {1989},
pages = {83--108},
publisher = {Kluwer Academic Publishers}
}
Years of Citing Articles
OpenURL
Abstract
In comparison to symbolic differentiation and numerical differencing, the chain rule based technique of automatic differentiation is shown to evaluate partial derivatives accurately and cheaply. In particular it is demonstrated that the reverse mode of automatic differentiation yields any gradient vector at no more than five times the cost of evaluating the underlying scalar function. After developing the basic mathematics we describe several software implementations and briefly discuss the ramifications for optimization.







