M3B Corpus: Multi-modal meeting behavior corpus for group meeting assessment

Yusuke Soneda, Yuki Matsuda, Yutaka Arakawa, Keiichi Yasumoto

研究成果: 著書/レポートタイプへの貢献会議での発言

抄録

This paper is the first trial to create a corpus on human-to-human multi-modal communication among multiple persons in group discussions. Our corpus includes not only video conversations but also the head movement and eye gaze. In addition, it includes detailed labels about the behaviors appeared in the discussion. Since we focused on the micro-behavior, we classified the general behavior into more detailed behaviors based on those meaning. For example, we have four types of smile: response, agree, interesting, sympathy. Because it takes much effort to create such corpus having multiple sensor data and detailed labels, it seems that no one has created it. In this work, we first attempted to create a corpus called “M3B Corpus (Multi-Modal Meeting Behavior Corpus),” which includes 320 minutes discussion among 21 Japanese students in total by developing the recording system that can handle multiple sensors and 360-degree camera simultaneously and synchronously. In this paper, we introduce our developed recording system and report the detail of M3B Corpus.

元の言語英語
ホスト出版物のタイトルUbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers
出版者Association for Computing Machinery, Inc
ページ825-834
ページ数10
ISBN(電子版)9781450368698
DOI
出版物ステータス出版済み - 9 9 2019
イベント2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2019 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2019 - London, 英国
継続期間: 9 9 20199 13 2019

出版物シリーズ

名前UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

会議

会議2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2019 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2019
英国
London
期間9/9/199/13/19

Fingerprint

Labels
Sensors
Cameras
Students
Communication

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

これを引用

Soneda, Y., Matsuda, Y., Arakawa, Y., & Yasumoto, K. (2019). M3B Corpus: Multi-modal meeting behavior corpus for group meeting assessment. : UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (pp. 825-834). (UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers). Association for Computing Machinery, Inc. https://doi.org/10.1145/3341162.3345588

M3B Corpus : Multi-modal meeting behavior corpus for group meeting assessment. / Soneda, Yusuke; Matsuda, Yuki; Arakawa, Yutaka; Yasumoto, Keiichi.

UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, 2019. p. 825-834 (UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers).

研究成果: 著書/レポートタイプへの貢献会議での発言

Soneda, Y, Matsuda, Y, Arakawa, Y & Yasumoto, K 2019, M3B Corpus: Multi-modal meeting behavior corpus for group meeting assessment. : UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers, Association for Computing Machinery, Inc, pp. 825-834, 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2019 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2019, London, 英国, 9/9/19. https://doi.org/10.1145/3341162.3345588
Soneda Y, Matsuda Y, Arakawa Y, Yasumoto K. M3B Corpus: Multi-modal meeting behavior corpus for group meeting assessment. : UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc. 2019. p. 825-834. (UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers). https://doi.org/10.1145/3341162.3345588
Soneda, Yusuke ; Matsuda, Yuki ; Arakawa, Yutaka ; Yasumoto, Keiichi. / M3B Corpus : Multi-modal meeting behavior corpus for group meeting assessment. UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, 2019. pp. 825-834 (UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers).
@inproceedings{b174484738f2437eb98f562c0802905b,
title = "M3B Corpus: Multi-modal meeting behavior corpus for group meeting assessment",
abstract = "This paper is the first trial to create a corpus on human-to-human multi-modal communication among multiple persons in group discussions. Our corpus includes not only video conversations but also the head movement and eye gaze. In addition, it includes detailed labels about the behaviors appeared in the discussion. Since we focused on the micro-behavior, we classified the general behavior into more detailed behaviors based on those meaning. For example, we have four types of smile: response, agree, interesting, sympathy. Because it takes much effort to create such corpus having multiple sensor data and detailed labels, it seems that no one has created it. In this work, we first attempted to create a corpus called “M3B Corpus (Multi-Modal Meeting Behavior Corpus),” which includes 320 minutes discussion among 21 Japanese students in total by developing the recording system that can handle multiple sensors and 360-degree camera simultaneously and synchronously. In this paper, we introduce our developed recording system and report the detail of M3B Corpus.",
author = "Yusuke Soneda and Yuki Matsuda and Yutaka Arakawa and Keiichi Yasumoto",
year = "2019",
month = "9",
day = "9",
doi = "10.1145/3341162.3345588",
language = "English",
series = "UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers",
publisher = "Association for Computing Machinery, Inc",
pages = "825--834",
booktitle = "UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers",

}

TY - GEN

T1 - M3B Corpus

T2 - Multi-modal meeting behavior corpus for group meeting assessment

AU - Soneda, Yusuke

AU - Matsuda, Yuki

AU - Arakawa, Yutaka

AU - Yasumoto, Keiichi

PY - 2019/9/9

Y1 - 2019/9/9

N2 - This paper is the first trial to create a corpus on human-to-human multi-modal communication among multiple persons in group discussions. Our corpus includes not only video conversations but also the head movement and eye gaze. In addition, it includes detailed labels about the behaviors appeared in the discussion. Since we focused on the micro-behavior, we classified the general behavior into more detailed behaviors based on those meaning. For example, we have four types of smile: response, agree, interesting, sympathy. Because it takes much effort to create such corpus having multiple sensor data and detailed labels, it seems that no one has created it. In this work, we first attempted to create a corpus called “M3B Corpus (Multi-Modal Meeting Behavior Corpus),” which includes 320 minutes discussion among 21 Japanese students in total by developing the recording system that can handle multiple sensors and 360-degree camera simultaneously and synchronously. In this paper, we introduce our developed recording system and report the detail of M3B Corpus.

AB - This paper is the first trial to create a corpus on human-to-human multi-modal communication among multiple persons in group discussions. Our corpus includes not only video conversations but also the head movement and eye gaze. In addition, it includes detailed labels about the behaviors appeared in the discussion. Since we focused on the micro-behavior, we classified the general behavior into more detailed behaviors based on those meaning. For example, we have four types of smile: response, agree, interesting, sympathy. Because it takes much effort to create such corpus having multiple sensor data and detailed labels, it seems that no one has created it. In this work, we first attempted to create a corpus called “M3B Corpus (Multi-Modal Meeting Behavior Corpus),” which includes 320 minutes discussion among 21 Japanese students in total by developing the recording system that can handle multiple sensors and 360-degree camera simultaneously and synchronously. In this paper, we introduce our developed recording system and report the detail of M3B Corpus.

UR - http://www.scopus.com/inward/record.url?scp=85072897010&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072897010&partnerID=8YFLogxK

U2 - 10.1145/3341162.3345588

DO - 10.1145/3341162.3345588

M3 - Conference contribution

AN - SCOPUS:85072897010

T3 - UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

SP - 825

EP - 834

BT - UbiComp/ISWC 2019- - Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

PB - Association for Computing Machinery, Inc

ER -