Hybrid Universal Learning Networks

Dazi Li, Jinglu Hu, Junichi Murata, Kotaro Hirasawa

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

A variety of neuron models combine the neural inputs through their summation and sigmoidal functions. Such structure of neural networks leads to shortcomings such as a large number of neurons in hidden layers and huge training data required. We introduce a kind of multiplication neuron which multiplies their inputs instead of summing to overcome the above problems. A hybrid universal learning network constructed by the combination of multiplication units arid summation units is proposed and trained for several well known benchmark problems. Different combinations of the above two are tried. It is clarified that multiplication is an essential computational element in many cases and the combination of the multiplication units with summation units in different layers in the networks improved the performance of the network.

Original languageEnglish
Pages (from-to)552-559
Number of pages8
JournalIEEJ Transactions on Electronics, Information and Systems
Volume123
Issue number3
DOIs
Publication statusPublished - Jan 1 2003

Fingerprint

Neurons
Neural networks

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Cite this

Hybrid Universal Learning Networks. / Li, Dazi; Hu, Jinglu; Murata, Junichi; Hirasawa, Kotaro.

In: IEEJ Transactions on Electronics, Information and Systems, Vol. 123, No. 3, 01.01.2003, p. 552-559.

Research output: Contribution to journalArticle

Li, Dazi ; Hu, Jinglu ; Murata, Junichi ; Hirasawa, Kotaro. / Hybrid Universal Learning Networks. In: IEEJ Transactions on Electronics, Information and Systems. 2003 ; Vol. 123, No. 3. pp. 552-559.
@article{dfda331e08fa42d2a8f3bf7498ad69c4,
title = "Hybrid Universal Learning Networks",
abstract = "A variety of neuron models combine the neural inputs through their summation and sigmoidal functions. Such structure of neural networks leads to shortcomings such as a large number of neurons in hidden layers and huge training data required. We introduce a kind of multiplication neuron which multiplies their inputs instead of summing to overcome the above problems. A hybrid universal learning network constructed by the combination of multiplication units arid summation units is proposed and trained for several well known benchmark problems. Different combinations of the above two are tried. It is clarified that multiplication is an essential computational element in many cases and the combination of the multiplication units with summation units in different layers in the networks improved the performance of the network.",
author = "Dazi Li and Jinglu Hu and Junichi Murata and Kotaro Hirasawa",
year = "2003",
month = "1",
day = "1",
doi = "10.1541/ieejeiss.123.552",
language = "English",
volume = "123",
pages = "552--559",
journal = "IEEJ Transactions on Electronics, Information and Systems",
issn = "0385-4221",
publisher = "The Institute of Electrical Engineers of Japan",
number = "3",

}

TY - JOUR

T1 - Hybrid Universal Learning Networks

AU - Li, Dazi

AU - Hu, Jinglu

AU - Murata, Junichi

AU - Hirasawa, Kotaro

PY - 2003/1/1

Y1 - 2003/1/1

N2 - A variety of neuron models combine the neural inputs through their summation and sigmoidal functions. Such structure of neural networks leads to shortcomings such as a large number of neurons in hidden layers and huge training data required. We introduce a kind of multiplication neuron which multiplies their inputs instead of summing to overcome the above problems. A hybrid universal learning network constructed by the combination of multiplication units arid summation units is proposed and trained for several well known benchmark problems. Different combinations of the above two are tried. It is clarified that multiplication is an essential computational element in many cases and the combination of the multiplication units with summation units in different layers in the networks improved the performance of the network.

AB - A variety of neuron models combine the neural inputs through their summation and sigmoidal functions. Such structure of neural networks leads to shortcomings such as a large number of neurons in hidden layers and huge training data required. We introduce a kind of multiplication neuron which multiplies their inputs instead of summing to overcome the above problems. A hybrid universal learning network constructed by the combination of multiplication units arid summation units is proposed and trained for several well known benchmark problems. Different combinations of the above two are tried. It is clarified that multiplication is an essential computational element in many cases and the combination of the multiplication units with summation units in different layers in the networks improved the performance of the network.

UR - http://www.scopus.com/inward/record.url?scp=10844225644&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10844225644&partnerID=8YFLogxK

U2 - 10.1541/ieejeiss.123.552

DO - 10.1541/ieejeiss.123.552

M3 - Article

VL - 123

SP - 552

EP - 559

JO - IEEJ Transactions on Electronics, Information and Systems

JF - IEEJ Transactions on Electronics, Information and Systems

SN - 0385-4221

IS - 3

ER -