Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Extended learning environments involving system to collect data for learning analytics and to support learners will be useful for all-age education. As the first steps towards to build new learning environments, we developed a system for multimodal learning analytics using eye-tracker and EEG measurement, and inclusive user interface design for elderly learners by dual-tablet system. Multimodal learning analytics system can be supportive to extract where and how learners with varied backgrounds feel difficulty in learning process. The eye-tracker can retrieve information where the learners paid attention. EEG signals will provide clues to estimate their mental states during gazes in learning. We developed simultaneous measurement system of these multimodal responses and are trying to integrate the information to explore learning problems. A dual-tablet user interface with simplified visual layers and more intuitive operations was designed aiming to reduce the physical and mental loads of elderly learners. A prototype was developed based on a cross-platform framework, which is being refined by iterative formative evaluations participated by elderlies, in order to improve the usability of the interface design. We propose a system architecture applying the multimodal learning analytics and the user-friendly design for elderly learners, which couples learning analytics “in the wild” environment and learning analytics in controlled lab environments.

Original languageEnglish
Title of host publicationCross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
EditorsPei-Luen Patrick Rau
PublisherSpringer Verlag
Pages469-481
Number of pages13
ISBN (Print)9783030225797
DOIs
Publication statusPublished - Jan 1 2019
Event11th International Conference on Cross-Cultural Design, CCD 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States
Duration: Jul 26 2019Jul 31 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11577 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th International Conference on Cross-Cultural Design, CCD 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019
CountryUnited States
CityOrlando
Period7/26/197/31/19

Fingerprint

Electroencephalography
User interfaces
Learning Environment
Education
User Interface Design
Interface Design
Learning
System Architecture
Measurement System
Learning Process
Usability
User Interface
Intuitive
Integrate
Prototype
Evaluation
Estimate
Electroencephalogram

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Tamura, K., Lu, M., Konomi, S., Hatano, K., Inaba, M., Oi, M., ... Yamada, Y. (2019). Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages. In P-L. P. Rau (Ed.), Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings (pp. 469-481). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11577 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-22580-3_35

Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages. / Tamura, Kaori; Lu, Min; Konomi, Shin’ichi; Hatano, Kohei; Inaba, Miyuki; Oi, Misato; Okamoto, Tsuyoshi; Okubo, Fumiya; Shimada, Atsushi; Wang, Jingyun; Yamada, Masanori; Yamada, Yuki.

Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. ed. / Pei-Luen Patrick Rau. Springer Verlag, 2019. p. 469-481 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11577 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tamura, K, Lu, M, Konomi, S, Hatano, K, Inaba, M, Oi, M, Okamoto, T, Okubo, F, Shimada, A, Wang, J, Yamada, M & Yamada, Y 2019, Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages. in P-LP Rau (ed.), Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11577 LNCS, Springer Verlag, pp. 469-481, 11th International Conference on Cross-Cultural Design, CCD 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019, Orlando, United States, 7/26/19. https://doi.org/10.1007/978-3-030-22580-3_35
Tamura K, Lu M, Konomi S, Hatano K, Inaba M, Oi M et al. Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages. In Rau P-LP, editor, Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. Springer Verlag. 2019. p. 469-481. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-22580-3_35
Tamura, Kaori ; Lu, Min ; Konomi, Shin’ichi ; Hatano, Kohei ; Inaba, Miyuki ; Oi, Misato ; Okamoto, Tsuyoshi ; Okubo, Fumiya ; Shimada, Atsushi ; Wang, Jingyun ; Yamada, Masanori ; Yamada, Yuki. / Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages. Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. editor / Pei-Luen Patrick Rau. Springer Verlag, 2019. pp. 469-481 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{e9318943d5984db099de2cfd4f7579d2,
title = "Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages",
abstract = "Extended learning environments involving system to collect data for learning analytics and to support learners will be useful for all-age education. As the first steps towards to build new learning environments, we developed a system for multimodal learning analytics using eye-tracker and EEG measurement, and inclusive user interface design for elderly learners by dual-tablet system. Multimodal learning analytics system can be supportive to extract where and how learners with varied backgrounds feel difficulty in learning process. The eye-tracker can retrieve information where the learners paid attention. EEG signals will provide clues to estimate their mental states during gazes in learning. We developed simultaneous measurement system of these multimodal responses and are trying to integrate the information to explore learning problems. A dual-tablet user interface with simplified visual layers and more intuitive operations was designed aiming to reduce the physical and mental loads of elderly learners. A prototype was developed based on a cross-platform framework, which is being refined by iterative formative evaluations participated by elderlies, in order to improve the usability of the interface design. We propose a system architecture applying the multimodal learning analytics and the user-friendly design for elderly learners, which couples learning analytics “in the wild” environment and learning analytics in controlled lab environments.",
author = "Kaori Tamura and Min Lu and Shin’ichi Konomi and Kohei Hatano and Miyuki Inaba and Misato Oi and Tsuyoshi Okamoto and Fumiya Okubo and Atsushi Shimada and Jingyun Wang and Masanori Yamada and Yuki Yamada",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-22580-3_35",
language = "English",
isbn = "9783030225797",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "469--481",
editor = "Rau, {Pei-Luen Patrick}",
booktitle = "Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings",
address = "Germany",

}

TY - GEN

T1 - Integrating Multimodal Learning Analytics and Inclusive Learning Support Systems for People of All Ages

AU - Tamura, Kaori

AU - Lu, Min

AU - Konomi, Shin’ichi

AU - Hatano, Kohei

AU - Inaba, Miyuki

AU - Oi, Misato

AU - Okamoto, Tsuyoshi

AU - Okubo, Fumiya

AU - Shimada, Atsushi

AU - Wang, Jingyun

AU - Yamada, Masanori

AU - Yamada, Yuki

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Extended learning environments involving system to collect data for learning analytics and to support learners will be useful for all-age education. As the first steps towards to build new learning environments, we developed a system for multimodal learning analytics using eye-tracker and EEG measurement, and inclusive user interface design for elderly learners by dual-tablet system. Multimodal learning analytics system can be supportive to extract where and how learners with varied backgrounds feel difficulty in learning process. The eye-tracker can retrieve information where the learners paid attention. EEG signals will provide clues to estimate their mental states during gazes in learning. We developed simultaneous measurement system of these multimodal responses and are trying to integrate the information to explore learning problems. A dual-tablet user interface with simplified visual layers and more intuitive operations was designed aiming to reduce the physical and mental loads of elderly learners. A prototype was developed based on a cross-platform framework, which is being refined by iterative formative evaluations participated by elderlies, in order to improve the usability of the interface design. We propose a system architecture applying the multimodal learning analytics and the user-friendly design for elderly learners, which couples learning analytics “in the wild” environment and learning analytics in controlled lab environments.

AB - Extended learning environments involving system to collect data for learning analytics and to support learners will be useful for all-age education. As the first steps towards to build new learning environments, we developed a system for multimodal learning analytics using eye-tracker and EEG measurement, and inclusive user interface design for elderly learners by dual-tablet system. Multimodal learning analytics system can be supportive to extract where and how learners with varied backgrounds feel difficulty in learning process. The eye-tracker can retrieve information where the learners paid attention. EEG signals will provide clues to estimate their mental states during gazes in learning. We developed simultaneous measurement system of these multimodal responses and are trying to integrate the information to explore learning problems. A dual-tablet user interface with simplified visual layers and more intuitive operations was designed aiming to reduce the physical and mental loads of elderly learners. A prototype was developed based on a cross-platform framework, which is being refined by iterative formative evaluations participated by elderlies, in order to improve the usability of the interface design. We propose a system architecture applying the multimodal learning analytics and the user-friendly design for elderly learners, which couples learning analytics “in the wild” environment and learning analytics in controlled lab environments.

UR - http://www.scopus.com/inward/record.url?scp=85069824083&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069824083&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-22580-3_35

DO - 10.1007/978-3-030-22580-3_35

M3 - Conference contribution

AN - SCOPUS:85069824083

SN - 9783030225797

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 469

EP - 481

BT - Cross-Cultural Design. Culture and Society - 11th International Conference, CCD 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings

A2 - Rau, Pei-Luen Patrick

PB - Springer Verlag

ER -