Action Input Interface of IntelligentBox Using 360-Degree VR Camera and OpenPose for Multi-persons’ Collaborative VR Applications

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper proposes action input interface of IntelligentBox for multi-persons’ collaborative VR applications. IntelligentBox ia a component-based constructive 3D graphics application development system. One of the application fields of IntelligentBox is VR. VR applications should support various types of VR peripherals, e.g., HMD (Head Mount Display), Data Gloves and so on. IntelligentBox supports most of them as dedicated software components. As for action input interfaces of VR applications, they support a motion capture system and MS Kinect. However, basically, such input interface supports one person’s actions. For multi-persons’ collaborative VR applications, the other action input interface is needed. Then, this paper proposes such an action input interface using 360° VR camera and OpenPose. In the interface, first a 360° VR camera captures all the persons’ images in the real world at the same time. Then, OpenPose recognizes all the persons’ poses in real time and output those poses as their skeletons in the json format. This time, the authors developed one dedicated software that generates multi-persons’ motion data from the output json format data and send them into a certain component of IntelligentBox through socket communication. The developed software works as a server of the server-client framework so that it can be used as a general action input interface for other client applications.

Original languageEnglish
Title of host publicationComplex, Intelligent and Software Intensive Systems - Proceedings of the 15th International Conference on Complex, Intelligent and Software Intensive Systems CISIS-2021
EditorsLeonard Barolli, Kangbin Yim, Tomoya Enokido
PublisherSpringer Science and Business Media Deutschland GmbH
Pages747-757
Number of pages11
ISBN (Print)9783030797249
DOIs
Publication statusPublished - 2021
Event15th International Conference on Complex, Intelligent, and Software Intensive Systems, CISIS 2021 - Asan, Korea, Republic of
Duration: Jul 1 2021Jul 3 2021

Publication series

NameLecture Notes in Networks and Systems
Volume278
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389

Conference

Conference15th International Conference on Complex, Intelligent, and Software Intensive Systems, CISIS 2021
Country/TerritoryKorea, Republic of
CityAsan
Period7/1/217/3/21

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Action Input Interface of IntelligentBox Using 360-Degree VR Camera and OpenPose for Multi-persons’ Collaborative VR Applications'. Together they form a unique fingerprint.

Cite this