Self-augmented multi-modal feature embedding

Shinnosuke Matsuo, Seiichi Uchida, Brian Kenji Iwana

研究成果: Contribution to journalConference article査読


Oftentimes, patterns can be represented through different modalities. For example, leaf data can be in the form of images or contours. Handwritten characters can also be either online or offline. To exploit this fact, we propose the use of self-augmentation and combine it with multi-modal feature embedding. In order to take advantage of the complementary information from the different modalities, the self-augmented multi-modal feature embedding employs a shared feature space. Through experimental results on classification with online handwriting and leaf images, we demonstrate that the proposed method can create effective embeddings.

ジャーナルICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
出版ステータス出版済み - 2021
イベント2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 - Virtual, Toronto, カナダ
継続期間: 6 6 20216 11 2021

All Science Journal Classification (ASJC) codes

  • ソフトウェア
  • 信号処理
  • 電子工学および電気工学