Reproducibility of findings from educational big data: A preliminary study

Misato Terai, Masanori Yamada, Fumiya Okubo, Atsushi Shimada, Hiroaki Ogata

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we examined whether previous findings on educational big data consisting of e-book logs from a given academic course can be reproduced with different data from other academic courses. The previous findings showed that (1) students who attained consistently good achievement more frequently browsed different e-books and their pages than low achievers and that (2) this difference was found only for logs of preparation for course sessions (preview), not for reviewing material (review). Preliminarily, we analyzed e-book logs from four courses. The results were reproduced in only one course and only partially, that is, (1) high achievers more frequently changed e-books than low achievers (2) for preview. This finding suggests that to allow effective usage of learning and teaching analyses, we need to carefully construct an educational environment to ensure reproducibility.

Original languageEnglish
Title of host publicationLAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference
Subtitle of host publicationUnderstanding, Informing and Improving Learning with Data
PublisherAssociation for Computing Machinery
Pages536-537
Number of pages2
ISBN (Electronic)9781450348706
DOIs
Publication statusPublished - Mar 13 2017
Event7th International Conference on Learning Analytics and Knowledge, LAK 2017 - Vancouver, Canada
Duration: Mar 13 2017Mar 17 2017

Publication series

NameACM International Conference Proceeding Series

Other

Other7th International Conference on Learning Analytics and Knowledge, LAK 2017
CountryCanada
CityVancouver
Period3/13/173/17/17

Fingerprint

Teaching
Students
Big data

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this

Terai, M., Yamada, M., Okubo, F., Shimada, A., & Ogata, H. (2017). Reproducibility of findings from educational big data: A preliminary study. In LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data (pp. 536-537). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3027385.3029445

Reproducibility of findings from educational big data : A preliminary study. / Terai, Misato; Yamada, Masanori; Okubo, Fumiya; Shimada, Atsushi; Ogata, Hiroaki.

LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. Association for Computing Machinery, 2017. p. 536-537 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Terai, M, Yamada, M, Okubo, F, Shimada, A & Ogata, H 2017, Reproducibility of findings from educational big data: A preliminary study. in LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. ACM International Conference Proceeding Series, Association for Computing Machinery, pp. 536-537, 7th International Conference on Learning Analytics and Knowledge, LAK 2017, Vancouver, Canada, 3/13/17. https://doi.org/10.1145/3027385.3029445
Terai M, Yamada M, Okubo F, Shimada A, Ogata H. Reproducibility of findings from educational big data: A preliminary study. In LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. Association for Computing Machinery. 2017. p. 536-537. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3027385.3029445
Terai, Misato ; Yamada, Masanori ; Okubo, Fumiya ; Shimada, Atsushi ; Ogata, Hiroaki. / Reproducibility of findings from educational big data : A preliminary study. LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference: Understanding, Informing and Improving Learning with Data. Association for Computing Machinery, 2017. pp. 536-537 (ACM International Conference Proceeding Series).
@inproceedings{982705ddb3834d6092c5ee6d9a20712d,
title = "Reproducibility of findings from educational big data: A preliminary study",
abstract = "In this paper, we examined whether previous findings on educational big data consisting of e-book logs from a given academic course can be reproduced with different data from other academic courses. The previous findings showed that (1) students who attained consistently good achievement more frequently browsed different e-books and their pages than low achievers and that (2) this difference was found only for logs of preparation for course sessions (preview), not for reviewing material (review). Preliminarily, we analyzed e-book logs from four courses. The results were reproduced in only one course and only partially, that is, (1) high achievers more frequently changed e-books than low achievers (2) for preview. This finding suggests that to allow effective usage of learning and teaching analyses, we need to carefully construct an educational environment to ensure reproducibility.",
author = "Misato Terai and Masanori Yamada and Fumiya Okubo and Atsushi Shimada and Hiroaki Ogata",
year = "2017",
month = "3",
day = "13",
doi = "10.1145/3027385.3029445",
language = "English",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
pages = "536--537",
booktitle = "LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference",

}

TY - GEN

T1 - Reproducibility of findings from educational big data

T2 - A preliminary study

AU - Terai, Misato

AU - Yamada, Masanori

AU - Okubo, Fumiya

AU - Shimada, Atsushi

AU - Ogata, Hiroaki

PY - 2017/3/13

Y1 - 2017/3/13

N2 - In this paper, we examined whether previous findings on educational big data consisting of e-book logs from a given academic course can be reproduced with different data from other academic courses. The previous findings showed that (1) students who attained consistently good achievement more frequently browsed different e-books and their pages than low achievers and that (2) this difference was found only for logs of preparation for course sessions (preview), not for reviewing material (review). Preliminarily, we analyzed e-book logs from four courses. The results were reproduced in only one course and only partially, that is, (1) high achievers more frequently changed e-books than low achievers (2) for preview. This finding suggests that to allow effective usage of learning and teaching analyses, we need to carefully construct an educational environment to ensure reproducibility.

AB - In this paper, we examined whether previous findings on educational big data consisting of e-book logs from a given academic course can be reproduced with different data from other academic courses. The previous findings showed that (1) students who attained consistently good achievement more frequently browsed different e-books and their pages than low achievers and that (2) this difference was found only for logs of preparation for course sessions (preview), not for reviewing material (review). Preliminarily, we analyzed e-book logs from four courses. The results were reproduced in only one course and only partially, that is, (1) high achievers more frequently changed e-books than low achievers (2) for preview. This finding suggests that to allow effective usage of learning and teaching analyses, we need to carefully construct an educational environment to ensure reproducibility.

UR - http://www.scopus.com/inward/record.url?scp=85016477103&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016477103&partnerID=8YFLogxK

U2 - 10.1145/3027385.3029445

DO - 10.1145/3027385.3029445

M3 - Conference contribution

AN - SCOPUS:85016477103

T3 - ACM International Conference Proceeding Series

SP - 536

EP - 537

BT - LAK 2017 Conference Proceedings - 7th International Learning Analytics and Knowledge Conference

PB - Association for Computing Machinery

ER -