A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.

Original languageEnglish
Title of host publicationComputer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers
EditorsC.V. Jawahar, Hongdong Li, Konrad Schindler, Greg Mori
PublisherSpringer Verlag
Pages414-430
Number of pages17
ISBN (Print)9783030208899
DOIs
Publication statusPublished - Jan 1 2019
Event14th Asian Conference on Computer Vision, ACCV 2018 - Perth, Australia
Duration: Dec 2 2018Dec 6 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11362 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th Asian Conference on Computer Vision, ACCV 2018
CountryAustralia
CityPerth
Period12/2/1812/6/18

Fingerprint

Autocorrelation
Multiplication
Neural networks
Backpropagation
Pixels
Experiments
Neural Networks
Back Propagation
Pixel
Higher Order
kernel
Calculate
Output
Experiment

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Hayashi, H., & Uchida, S. (2019). A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. In C. V. Jawahar, H. Li, K. Schindler, & G. Mori (Eds.), Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers (pp. 414-430). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11362 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-20890-5_27

A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. / Hayashi, Hideaki; Uchida, Seiichi.

Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. ed. / C.V. Jawahar; Hongdong Li; Konrad Schindler; Greg Mori. Springer Verlag, 2019. p. 414-430 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11362 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hayashi, H & Uchida, S 2019, A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. in CV Jawahar, H Li, K Schindler & G Mori (eds), Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11362 LNCS, Springer Verlag, pp. 414-430, 14th Asian Conference on Computer Vision, ACCV 2018, Perth, Australia, 12/2/18. https://doi.org/10.1007/978-3-030-20890-5_27
Hayashi H, Uchida S. A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. In Jawahar CV, Li H, Schindler K, Mori G, editors, Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. Springer Verlag. 2019. p. 414-430. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-20890-5_27
Hayashi, Hideaki ; Uchida, Seiichi. / A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction. Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers. editor / C.V. Jawahar ; Hongdong Li ; Konrad Schindler ; Greg Mori. Springer Verlag, 2019. pp. 414-430 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{89cfbaa725b343768614d3948e25818b,
title = "A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction",
abstract = "In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.",
author = "Hideaki Hayashi and Seiichi Uchida",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-20890-5_27",
language = "English",
isbn = "9783030208899",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "414--430",
editor = "C.V. Jawahar and Hongdong Li and Konrad Schindler and Greg Mori",
booktitle = "Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers",
address = "Germany",

}

TY - GEN

T1 - A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction

AU - Hayashi, Hideaki

AU - Uchida, Seiichi

PY - 2019/1/1

Y1 - 2019/1/1

N2 - In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.

AB - In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.

UR - http://www.scopus.com/inward/record.url?scp=85067357575&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067357575&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-20890-5_27

DO - 10.1007/978-3-030-20890-5_27

M3 - Conference contribution

AN - SCOPUS:85067357575

SN - 9783030208899

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 414

EP - 430

BT - Computer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers

A2 - Jawahar, C.V.

A2 - Li, Hongdong

A2 - Schindler, Konrad

A2 - Mori, Greg

PB - Springer Verlag

ER -