Monthly
288 pp. per issue
6 x 9, illustrated
ISSN
0899-7667
E-ISSN
1530-888X
2014 Impact factor:
2.21

Neural Computation

January 1, 1997, Vol. 9, No. 1, Pages 185-204
(doi: 10.1162/neco.1997.9.1.185)
© 1997 Massachusetts Institute of Technology
A Penalty-Function Approach for Pruning Feedforward Neural Networks
Article PDF (185.91 KB)
Abstract

This article proposes the use of a penalty function for pruning feedforward neural network by weight elimination. The penalty function proposed consists of two terms. The first term is to discourage the use of unnecessary connections, and the second term is to prevent the weights of the connections from taking excessively large values. Simple criteria for eliminating weights from the network are also given. The effectiveness of this penalty function is tested on three well-known problems: the contiguity problem, the parity problems, and the monks problems. The resulting pruned networks obtained for many of these problems have fewer connections than previously reported in the literature.