Local N-ary Patterns: A local multi-modal descriptor for place categorization

Hojung Jung, Oscar Martinez Mozos, Yumi Iwashita, Ryo Kurazume

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

This paper presents an effective integration method of multiple modalities such as depth, color, and reflectance for place categorization. To achieve better performance with integrated multi-modalities, we introduce a novel descriptor, local N-ary patterns (LTP), which can perform robust discrimination of place categorization. In this paper, the LNP descriptor is applied to a combination of two modalities, i.e. depth and reflectance, provided by a laser range finder. However, the LNP descriptor can be easily extended to a larger number of modalities. The proposed LNP describes relationships between the multi-modal values of pixels and their neighboring pixels. Since we consider the multi-modal relationship, our proposed method clearly demonstrates more effective classification results than using individual modalities. We carried out experiments with the Kyushu University Indoor Semantic Place Dataset, which is publicly available. This data-set is composed of five indoor categories: corridors, kitchens, laboratories, study rooms, and offices. We confirmed that our proposed method outperforms previous uni-modal descriptors.

Original languageEnglish
Pages (from-to)402-415
Number of pages14
JournalAdvanced Robotics
Volume30
Issue number6
DOIs
Publication statusPublished - Mar 18 2016

Fingerprint

Pixels
Kitchens
Range finders
Semantics
Color
Lasers
Experiments

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Software
  • Human-Computer Interaction
  • Hardware and Architecture
  • Computer Science Applications

Cite this

Local N-ary Patterns : A local multi-modal descriptor for place categorization. / Jung, Hojung; Mozos, Oscar Martinez; Iwashita, Yumi; Kurazume, Ryo.

In: Advanced Robotics, Vol. 30, No. 6, 18.03.2016, p. 402-415.

Research output: Contribution to journalArticle

Jung, Hojung ; Mozos, Oscar Martinez ; Iwashita, Yumi ; Kurazume, Ryo. / Local N-ary Patterns : A local multi-modal descriptor for place categorization. In: Advanced Robotics. 2016 ; Vol. 30, No. 6. pp. 402-415.
@article{771a91fcb5c5483e8e1241723fbdb3e1,
title = "Local N-ary Patterns: A local multi-modal descriptor for place categorization",
abstract = "This paper presents an effective integration method of multiple modalities such as depth, color, and reflectance for place categorization. To achieve better performance with integrated multi-modalities, we introduce a novel descriptor, local N-ary patterns (LTP), which can perform robust discrimination of place categorization. In this paper, the LNP descriptor is applied to a combination of two modalities, i.e. depth and reflectance, provided by a laser range finder. However, the LNP descriptor can be easily extended to a larger number of modalities. The proposed LNP describes relationships between the multi-modal values of pixels and their neighboring pixels. Since we consider the multi-modal relationship, our proposed method clearly demonstrates more effective classification results than using individual modalities. We carried out experiments with the Kyushu University Indoor Semantic Place Dataset, which is publicly available. This data-set is composed of five indoor categories: corridors, kitchens, laboratories, study rooms, and offices. We confirmed that our proposed method outperforms previous uni-modal descriptors.",
author = "Hojung Jung and Mozos, {Oscar Martinez} and Yumi Iwashita and Ryo Kurazume",
year = "2016",
month = "3",
day = "18",
doi = "10.1080/01691864.2015.1120242",
language = "English",
volume = "30",
pages = "402--415",
journal = "Advanced Robotics",
issn = "0169-1864",
publisher = "Taylor and Francis Ltd.",
number = "6",

}

TY - JOUR

T1 - Local N-ary Patterns

T2 - A local multi-modal descriptor for place categorization

AU - Jung, Hojung

AU - Mozos, Oscar Martinez

AU - Iwashita, Yumi

AU - Kurazume, Ryo

PY - 2016/3/18

Y1 - 2016/3/18

N2 - This paper presents an effective integration method of multiple modalities such as depth, color, and reflectance for place categorization. To achieve better performance with integrated multi-modalities, we introduce a novel descriptor, local N-ary patterns (LTP), which can perform robust discrimination of place categorization. In this paper, the LNP descriptor is applied to a combination of two modalities, i.e. depth and reflectance, provided by a laser range finder. However, the LNP descriptor can be easily extended to a larger number of modalities. The proposed LNP describes relationships between the multi-modal values of pixels and their neighboring pixels. Since we consider the multi-modal relationship, our proposed method clearly demonstrates more effective classification results than using individual modalities. We carried out experiments with the Kyushu University Indoor Semantic Place Dataset, which is publicly available. This data-set is composed of five indoor categories: corridors, kitchens, laboratories, study rooms, and offices. We confirmed that our proposed method outperforms previous uni-modal descriptors.

AB - This paper presents an effective integration method of multiple modalities such as depth, color, and reflectance for place categorization. To achieve better performance with integrated multi-modalities, we introduce a novel descriptor, local N-ary patterns (LTP), which can perform robust discrimination of place categorization. In this paper, the LNP descriptor is applied to a combination of two modalities, i.e. depth and reflectance, provided by a laser range finder. However, the LNP descriptor can be easily extended to a larger number of modalities. The proposed LNP describes relationships between the multi-modal values of pixels and their neighboring pixels. Since we consider the multi-modal relationship, our proposed method clearly demonstrates more effective classification results than using individual modalities. We carried out experiments with the Kyushu University Indoor Semantic Place Dataset, which is publicly available. This data-set is composed of five indoor categories: corridors, kitchens, laboratories, study rooms, and offices. We confirmed that our proposed method outperforms previous uni-modal descriptors.

UR - http://www.scopus.com/inward/record.url?scp=84954096136&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954096136&partnerID=8YFLogxK

U2 - 10.1080/01691864.2015.1120242

DO - 10.1080/01691864.2015.1120242

M3 - Article

AN - SCOPUS:84954096136

VL - 30

SP - 402

EP - 415

JO - Advanced Robotics

JF - Advanced Robotics

SN - 0169-1864

IS - 6

ER -