Structure designing method for feedforward and recurrent neural networks based on a net significant measure

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

A method is proposed for determining proper neural network structures. The method is a pruning method which removes insignificant connections from a large initial network to turn it into a network with less complexity but a better generalization ability. A new technique for evaluating net or non-superficial significance of each connection is proposed. Based on this significance measure, insignificant weights are deleted, and at the same time undeleted weights are modified to their relevant values without any additional learning. The significance measure is directly related to a measure of generalization ability; thus we can obtain a neural network with a good ability of generalization. The method is applicable to all those neural networks which have differentiable neurons and are trained by supervised learning, including multilayer feedforward and recurrent networks. The resultant network does not contain any redundant signals or any unnecessary weights. Therefore, it is easy to see how the network works. Several examples show the validity of the method.

Original languageEnglish
Pages (from-to)358-363
Number of pages6
JournalUnknown Journal
Issue number409
Publication statusPublished - 1995

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Structure designing method for feedforward and recurrent neural networks based on a net significant measure'. Together they form a unique fingerprint.

  • Cite this