A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction

研究成果: 著書/レポートタイプへの貢献会議での発言

抄録

In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.

元の言語英語
ホスト出版物のタイトルComputer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers
編集者C.V. Jawahar, Hongdong Li, Konrad Schindler, Greg Mori
出版者Springer Verlag
ページ414-430
ページ数17
ISBN(印刷物)9783030208899
DOI
出版物ステータス出版済み - 1 1 2019
イベント14th Asian Conference on Computer Vision, ACCV 2018 - Perth, オーストラリア
継続期間: 12 2 201812 6 2018

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11362 LNCS
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

会議

会議14th Asian Conference on Computer Vision, ACCV 2018
オーストラリア
Perth
期間12/2/1812/6/18

Fingerprint

Autocorrelation
Multiplication
Neural networks
Backpropagation
Pixels
Experiments
Neural Networks
Back Propagation
Pixel
Higher Order
kernel
Calculate
Output
Experiment

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

これを引用

Hayashi, H., & Uchida, S. (2019). A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. : C. V. Jawahar, H. Li, K. Schindler, & G. Mori (版), Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers (pp. 414-430). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 11362 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-20890-5_27

A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. / Hayashi, Hideaki; Uchida, Seiichi.

Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. 版 / C.V. Jawahar; Hongdong Li; Konrad Schindler; Greg Mori. Springer Verlag, 2019. p. 414-430 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻 11362 LNCS).

研究成果: 著書/レポートタイプへの貢献会議での発言

Hayashi, H & Uchida, S 2019, A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. : CV Jawahar, H Li, K Schindler & G Mori (版), Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 巻. 11362 LNCS, Springer Verlag, pp. 414-430, 14th Asian Conference on Computer Vision, ACCV 2018, Perth, オーストラリア, 12/2/18. https://doi.org/10.1007/978-3-030-20890-5_27
Hayashi H, Uchida S. A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. : Jawahar CV, Li H, Schindler K, Mori G, 編集者, Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. Springer Verlag. 2019. p. 414-430. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-20890-5_27
Hayashi, Hideaki ; Uchida, Seiichi. / A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. 編集者 / C.V. Jawahar ; Hongdong Li ; Konrad Schindler ; Greg Mori. Springer Verlag, 2019. pp. 414-430 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{89cfbaa725b343768614d3948e25818b,
title = "A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction",
abstract = "In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.",
author = "Hideaki Hayashi and Seiichi Uchida",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-20890-5_27",
language = "English",
isbn = "9783030208899",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "414--430",
editor = "C.V. Jawahar and Hongdong Li and Konrad Schindler and Greg Mori",
booktitle = "Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers",
address = "Germany",

}

TY - GEN

T1 - A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction

AU - Hayashi, Hideaki

AU - Uchida, Seiichi

PY - 2019/1/1

Y1 - 2019/1/1

N2 - In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.

AB - In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.

UR - http://www.scopus.com/inward/record.url?scp=85067357575&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067357575&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-20890-5_27

DO - 10.1007/978-3-030-20890-5_27

M3 - Conference contribution

SN - 9783030208899

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 414

EP - 430

BT - Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers

A2 - Jawahar, C.V.

A2 - Li, Hongdong

A2 - Schindler, Konrad

A2 - Mori, Greg

PB - Springer Verlag

ER -