Results 1 -
1 of
1
Incremental Communication for Multilayer Neural Networks: Error Analysis
, 1995
"... Artificial neural networks (ANNs) involve a large amount of inter-node communications. To reduce the communication cost as well as the time of learning process in ANNs, we earlier proposed an incremental inter-node communication method. In the incremental communication method, instead of communicati ..."
Abstract
-
Cited by 2 (1 self)
- Add to MetaCart
Artificial neural networks (ANNs) involve a large amount of inter-node communications. To reduce the communication cost as well as the time of learning process in ANNs, we earlier proposed an incremental inter-node communication method. In the incremental communication method, instead of communicating the full magnitude of the output value of a node, only the increment or decrement to its previous value is sent on a communication link. In this paper, the effects of the limited precision incremental communication method on the convergence behavior and performance of multilayer neural networks are investigated. The nonlinear aspects of representing the incremental values with reduced (limited) precision for the commonly used error backpropagation training algorithm are analyzed. It is shown that the nonlinear effect of small perturbations in the input(s)/output of a node does not enforce instability. The analysis is supported by simulation studies of two problems. The simulation results ...

