Automatic houseware registration system for informationally-structured environment

Kazuto Nakashima, Julien Girard, Yumi Iwashita, Ryo Kurazume

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To provide daily-life assistance appropriately by a service robot, the management of houseware's information in a room or a house is an indispensable function. Especially, the information about what and where objects are in the environment are fundamental and critical knowledge. We can track housewares with high reliability by attaching markers such as RFID tags to them, however, markerless housewares management system is still useful since it is easy-to-use and low cost. In this work, we present an object management system using an egocentric vision and a region-based convolutional neural network (R-CNN) to automatically detect and register housewares. The proposed system consists of smart glasses equipped with a wearable camera, a cloud database which manages object information, and a processing server for detecting and registering housewares to the cloud database. We perform two experiments. First, we train the R-CNN on a newly-constructed dataset to detect various housewares and configure a houseware-specific detector. All systems are composed of ROS packages. Second, we conduct experiments for automatic housewares registration using the proposed system. We demonstrate that the proposed system can detect, recognize, and register housewares approximately in real time.

Original languageEnglish
Title of host publicationSII 2016 - 2016 IEEE/SICE International Symposium on System Integration
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages337-342
Number of pages6
ISBN (Electronic)9781509033294
DOIs
Publication statusPublished - Feb 6 2017
Event2016 IEEE/SICE International Symposium on System Integration, SII 2016 - Sapporo, Japan
Duration: Dec 13 2016Dec 15 2016

Publication series

NameSII 2016 - 2016 IEEE/SICE International Symposium on System Integration

Other

Other2016 IEEE/SICE International Symposium on System Integration, SII 2016
CountryJapan
CitySapporo
Period12/13/1612/15/16

Fingerprint

Registration
Neural networks
Radio frequency identification (RFID)
Servers
Experiments
Cameras
Robots
Neural Networks
Reactive Oxygen Species
Detectors
Service Robot
Glass
Radio Frequency Identification
Processing
Experiment
Costs
Server
Camera
Detector
Demonstrate

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Control and Systems Engineering
  • Mechanical Engineering
  • Artificial Intelligence
  • Hardware and Architecture
  • Control and Optimization

Cite this

Nakashima, K., Girard, J., Iwashita, Y., & Kurazume, R. (2017). Automatic houseware registration system for informationally-structured environment. In SII 2016 - 2016 IEEE/SICE International Symposium on System Integration (pp. 337-342). [7844021] (SII 2016 - 2016 IEEE/SICE International Symposium on System Integration). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SII.2016.7844021

Automatic houseware registration system for informationally-structured environment. / Nakashima, Kazuto; Girard, Julien; Iwashita, Yumi; Kurazume, Ryo.

SII 2016 - 2016 IEEE/SICE International Symposium on System Integration. Institute of Electrical and Electronics Engineers Inc., 2017. p. 337-342 7844021 (SII 2016 - 2016 IEEE/SICE International Symposium on System Integration).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nakashima, K, Girard, J, Iwashita, Y & Kurazume, R 2017, Automatic houseware registration system for informationally-structured environment. in SII 2016 - 2016 IEEE/SICE International Symposium on System Integration., 7844021, SII 2016 - 2016 IEEE/SICE International Symposium on System Integration, Institute of Electrical and Electronics Engineers Inc., pp. 337-342, 2016 IEEE/SICE International Symposium on System Integration, SII 2016, Sapporo, Japan, 12/13/16. https://doi.org/10.1109/SII.2016.7844021
Nakashima K, Girard J, Iwashita Y, Kurazume R. Automatic houseware registration system for informationally-structured environment. In SII 2016 - 2016 IEEE/SICE International Symposium on System Integration. Institute of Electrical and Electronics Engineers Inc. 2017. p. 337-342. 7844021. (SII 2016 - 2016 IEEE/SICE International Symposium on System Integration). https://doi.org/10.1109/SII.2016.7844021
Nakashima, Kazuto ; Girard, Julien ; Iwashita, Yumi ; Kurazume, Ryo. / Automatic houseware registration system for informationally-structured environment. SII 2016 - 2016 IEEE/SICE International Symposium on System Integration. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 337-342 (SII 2016 - 2016 IEEE/SICE International Symposium on System Integration).
@inproceedings{db02883fc49a4cb6bc3538f53989eef5,
title = "Automatic houseware registration system for informationally-structured environment",
abstract = "To provide daily-life assistance appropriately by a service robot, the management of houseware's information in a room or a house is an indispensable function. Especially, the information about what and where objects are in the environment are fundamental and critical knowledge. We can track housewares with high reliability by attaching markers such as RFID tags to them, however, markerless housewares management system is still useful since it is easy-to-use and low cost. In this work, we present an object management system using an egocentric vision and a region-based convolutional neural network (R-CNN) to automatically detect and register housewares. The proposed system consists of smart glasses equipped with a wearable camera, a cloud database which manages object information, and a processing server for detecting and registering housewares to the cloud database. We perform two experiments. First, we train the R-CNN on a newly-constructed dataset to detect various housewares and configure a houseware-specific detector. All systems are composed of ROS packages. Second, we conduct experiments for automatic housewares registration using the proposed system. We demonstrate that the proposed system can detect, recognize, and register housewares approximately in real time.",
author = "Kazuto Nakashima and Julien Girard and Yumi Iwashita and Ryo Kurazume",
year = "2017",
month = "2",
day = "6",
doi = "10.1109/SII.2016.7844021",
language = "English",
series = "SII 2016 - 2016 IEEE/SICE International Symposium on System Integration",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "337--342",
booktitle = "SII 2016 - 2016 IEEE/SICE International Symposium on System Integration",
address = "United States",

}

TY - GEN

T1 - Automatic houseware registration system for informationally-structured environment

AU - Nakashima, Kazuto

AU - Girard, Julien

AU - Iwashita, Yumi

AU - Kurazume, Ryo

PY - 2017/2/6

Y1 - 2017/2/6

N2 - To provide daily-life assistance appropriately by a service robot, the management of houseware's information in a room or a house is an indispensable function. Especially, the information about what and where objects are in the environment are fundamental and critical knowledge. We can track housewares with high reliability by attaching markers such as RFID tags to them, however, markerless housewares management system is still useful since it is easy-to-use and low cost. In this work, we present an object management system using an egocentric vision and a region-based convolutional neural network (R-CNN) to automatically detect and register housewares. The proposed system consists of smart glasses equipped with a wearable camera, a cloud database which manages object information, and a processing server for detecting and registering housewares to the cloud database. We perform two experiments. First, we train the R-CNN on a newly-constructed dataset to detect various housewares and configure a houseware-specific detector. All systems are composed of ROS packages. Second, we conduct experiments for automatic housewares registration using the proposed system. We demonstrate that the proposed system can detect, recognize, and register housewares approximately in real time.

AB - To provide daily-life assistance appropriately by a service robot, the management of houseware's information in a room or a house is an indispensable function. Especially, the information about what and where objects are in the environment are fundamental and critical knowledge. We can track housewares with high reliability by attaching markers such as RFID tags to them, however, markerless housewares management system is still useful since it is easy-to-use and low cost. In this work, we present an object management system using an egocentric vision and a region-based convolutional neural network (R-CNN) to automatically detect and register housewares. The proposed system consists of smart glasses equipped with a wearable camera, a cloud database which manages object information, and a processing server for detecting and registering housewares to the cloud database. We perform two experiments. First, we train the R-CNN on a newly-constructed dataset to detect various housewares and configure a houseware-specific detector. All systems are composed of ROS packages. Second, we conduct experiments for automatic housewares registration using the proposed system. We demonstrate that the proposed system can detect, recognize, and register housewares approximately in real time.

UR - http://www.scopus.com/inward/record.url?scp=85015393921&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015393921&partnerID=8YFLogxK

U2 - 10.1109/SII.2016.7844021

DO - 10.1109/SII.2016.7844021

M3 - Conference contribution

AN - SCOPUS:85015393921

T3 - SII 2016 - 2016 IEEE/SICE International Symposium on System Integration

SP - 337

EP - 342

BT - SII 2016 - 2016 IEEE/SICE International Symposium on System Integration

PB - Institute of Electrical and Electronics Engineers Inc.

ER -