Tempering Backpropagation Networks: Not All Weights are Created Equal

Tempering Backpropagation Networks: Not All Weights are Created Equal (1996)

Cached

Download Links

[www.inf.ethz.ch]
[www.cs.jhu.edu]
[papers.cnl.salk.edu]

Other Repositories/Bibliography

DBLP

by Nicol N. Schraudolph , Terrence J. Sejnowski

Venue:	Advances in Neural Information Processing Systems
Citations:	12 - 7 self

BibTeX

@INPROCEEDINGS{Schraudolph96temperingbackpropagation,
    author = {Nicol N. Schraudolph and Terrence J. Sejnowski},
    title = {Tempering Backpropagation Networks: Not All Weights are Created Equal},
    booktitle = {Advances in Neural Information Processing Systems},
    year = {1996},
    pages = {563--569},
    publisher = {The MIT Press}
}

Bookmark

OpenURL

Abstract

Backpropagation learning algorithms typically collapse the network's structure into a single vector of weight parameters to be optimized. We suggest that their performance may be improved by utilizing the structural information instead of discarding it, and introduce a framework for "tempering" each weight accordingly.

Citations

2718	Neural Networks: A Comprehensive Foundation. Upper Saddle River - Haykin - 1999
283	Increased rates of convergence through learning rate adaptation - Jacobs
154	Learning distributed representations of concepts - Hinton - 1986
108	Second-Order Methods for Learning: Between Steepest Descent and Newton's Method - Battiti, First- - 1992
70	Biologically plausible error-driven learning using local activation differences: the generalized recirculation algorithm - O’Reilly - 1996
22	Second order properties of error surfaces: learning time, generalization - LeCun, Kanter, et al. - 1991
12	A cost function for internal representation - Krogh, Thorbergsson, et al. - 1990
7	Learning and statistical inference - Amari - 1995
3	Efficient learning and second-order methods,” in A tutorial - LeCun - 1993
1	Efficient learning & second-order methods - LeCun - 1993
1	Second order properties of error surfaces: Learning time and generalization - I, Solla - 1991