Coupled dictionary learning and feature mapping for cross-modal retrieval

研究成果: 著書/レポートタイプへの貢献会議での発言

18 引用 (Scopus)

抜粋

In this paper, we investigate the problem of modeling images and associated text for cross-modal retrieval tasks such as text-to-image search and image-to-text search. To make the data from image and text modalities comparable, previous cross-modal retrieval methods directly learn two projection matrices to map the raw features of the two modalities into a common subspace, in which cross-modal data matching can be performed. However, the different feature representations and correlation structures of different modalities inhibit these methods from efficiently modeling the relationships across modalities through a common subspace. To handle the diversities of different modalities, we first leverage the coupled dictionary learning method to generate homogeneous sparse representations for different modalities by associating and jointly updating their dictionaries. We then use a coupled feature mapping scheme to project the derived sparse representations from different modalities into a common subspace in which cross-modal retrieval can be performed. Experiments on a variety of cross-modal retrieval tasks demonstrate that the proposed method outperforms the state-of-the-art approaches.

元の言語英語
ホスト出版物のタイトル2015 IEEE International Conference on Multimedia and Expo, ICME 2015
出版者IEEE Computer Society
2015-August
ISBN(電子版)9781479970827
DOI
出版物ステータス出版済み - 8 4 2015
イベントIEEE International Conference on Multimedia and Expo, ICME 2015 - Turin, イタリア
継続期間: 6 29 20157 3 2015

その他

その他IEEE International Conference on Multimedia and Expo, ICME 2015
イタリア
Turin
期間6/29/157/3/15

    フィンガープリント

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications

これを引用

Xu, X., Shimada, A., Taniguchi, R-I., & He, L. (2015). Coupled dictionary learning and feature mapping for cross-modal retrieval. : 2015 IEEE International Conference on Multimedia and Expo, ICME 2015 (巻 2015-August). [7177396] IEEE Computer Society. https://doi.org/10.1109/ICME.2015.7177396