Non-Linear Matrix Completion for Social Image Tagging

Xing Xu, Li He, Huimin Lu, Atsushi Shimada, Rin-Ichiro Taniguchi

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

In this paper, we address the problem of social image tagging using practical vocabulary for mobile users on the social media. On the social media, images usually have an incomplete or noisy set of social tags provided by the mobile users, and we consider this issue as defective tag assignments. Previous studies on social image tagging have mostly focused on multi-label classification without considering the defective tags. In these studies, the usage of multi-label classification techniques is expected to synergically exploit the linear relations between the image features and the semantic tags. However, these approaches usually aimed to capture the linear relations from the training data while ignoring the helpful information from the test data. In addition, they failed to incorporate the non-linear associations residing in the visual features as well as in the semantic tags. To overcome these drawbacks, we introduce a novel approach based on non-linear matrix completion for image tagging task with defective tags. Specifically, we first construct the entire feature-tag matrix based on the visual features with non-linear kernel mapping. Then, we present a formal methodology together with an optimization method under the matrix completion framework to jointly complete the tags of training and test images. Experimental evaluations demonstrate that our method shows promising results on image tagging task on two benchmark social image datasets with defective tags, and establishes a baseline for such models in this research domain.

Original languageEnglish
Article number7762054
Pages (from-to)6688-6696
Number of pages9
JournalIEEE Access
Volume5
DOIs
Publication statusPublished - Jan 1 2017

Fingerprint

Labels
Semantics

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Cite this

Non-Linear Matrix Completion for Social Image Tagging. / Xu, Xing; He, Li; Lu, Huimin; Shimada, Atsushi; Taniguchi, Rin-Ichiro.

In: IEEE Access, Vol. 5, 7762054, 01.01.2017, p. 6688-6696.

Research output: Contribution to journalArticle

@article{e019900b4d0746978413fb1f40cf3792,
title = "Non-Linear Matrix Completion for Social Image Tagging",
abstract = "In this paper, we address the problem of social image tagging using practical vocabulary for mobile users on the social media. On the social media, images usually have an incomplete or noisy set of social tags provided by the mobile users, and we consider this issue as defective tag assignments. Previous studies on social image tagging have mostly focused on multi-label classification without considering the defective tags. In these studies, the usage of multi-label classification techniques is expected to synergically exploit the linear relations between the image features and the semantic tags. However, these approaches usually aimed to capture the linear relations from the training data while ignoring the helpful information from the test data. In addition, they failed to incorporate the non-linear associations residing in the visual features as well as in the semantic tags. To overcome these drawbacks, we introduce a novel approach based on non-linear matrix completion for image tagging task with defective tags. Specifically, we first construct the entire feature-tag matrix based on the visual features with non-linear kernel mapping. Then, we present a formal methodology together with an optimization method under the matrix completion framework to jointly complete the tags of training and test images. Experimental evaluations demonstrate that our method shows promising results on image tagging task on two benchmark social image datasets with defective tags, and establishes a baseline for such models in this research domain.",
author = "Xing Xu and Li He and Huimin Lu and Atsushi Shimada and Rin-Ichiro Taniguchi",
year = "2017",
month = "1",
day = "1",
doi = "10.1109/ACCESS.2016.2624267",
language = "English",
volume = "5",
pages = "6688--6696",
journal = "IEEE Access",
issn = "2169-3536",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Non-Linear Matrix Completion for Social Image Tagging

AU - Xu, Xing

AU - He, Li

AU - Lu, Huimin

AU - Shimada, Atsushi

AU - Taniguchi, Rin-Ichiro

PY - 2017/1/1

Y1 - 2017/1/1

N2 - In this paper, we address the problem of social image tagging using practical vocabulary for mobile users on the social media. On the social media, images usually have an incomplete or noisy set of social tags provided by the mobile users, and we consider this issue as defective tag assignments. Previous studies on social image tagging have mostly focused on multi-label classification without considering the defective tags. In these studies, the usage of multi-label classification techniques is expected to synergically exploit the linear relations between the image features and the semantic tags. However, these approaches usually aimed to capture the linear relations from the training data while ignoring the helpful information from the test data. In addition, they failed to incorporate the non-linear associations residing in the visual features as well as in the semantic tags. To overcome these drawbacks, we introduce a novel approach based on non-linear matrix completion for image tagging task with defective tags. Specifically, we first construct the entire feature-tag matrix based on the visual features with non-linear kernel mapping. Then, we present a formal methodology together with an optimization method under the matrix completion framework to jointly complete the tags of training and test images. Experimental evaluations demonstrate that our method shows promising results on image tagging task on two benchmark social image datasets with defective tags, and establishes a baseline for such models in this research domain.

AB - In this paper, we address the problem of social image tagging using practical vocabulary for mobile users on the social media. On the social media, images usually have an incomplete or noisy set of social tags provided by the mobile users, and we consider this issue as defective tag assignments. Previous studies on social image tagging have mostly focused on multi-label classification without considering the defective tags. In these studies, the usage of multi-label classification techniques is expected to synergically exploit the linear relations between the image features and the semantic tags. However, these approaches usually aimed to capture the linear relations from the training data while ignoring the helpful information from the test data. In addition, they failed to incorporate the non-linear associations residing in the visual features as well as in the semantic tags. To overcome these drawbacks, we introduce a novel approach based on non-linear matrix completion for image tagging task with defective tags. Specifically, we first construct the entire feature-tag matrix based on the visual features with non-linear kernel mapping. Then, we present a formal methodology together with an optimization method under the matrix completion framework to jointly complete the tags of training and test images. Experimental evaluations demonstrate that our method shows promising results on image tagging task on two benchmark social image datasets with defective tags, and establishes a baseline for such models in this research domain.

UR - http://www.scopus.com/inward/record.url?scp=85028081885&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028081885&partnerID=8YFLogxK

U2 - 10.1109/ACCESS.2016.2624267

DO - 10.1109/ACCESS.2016.2624267

M3 - Article

VL - 5

SP - 6688

EP - 6696

JO - IEEE Access

JF - IEEE Access

SN - 2169-3536

M1 - 7762054

ER -