Automatic assessment of student understanding for estimateing test score

Kyouhei Ueno, Tsunenori Mine

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Prediction of the level of student understanding to learning is one of crucial issues in education. The level of understating is usually estimated by simulation test scores from the assumption that there is a strong relationship between the level of understanding and a simulation test score. Meanwhile, instructors or teachers often assess student understanding by observing their learning status and use the assessment scores to give the students feedback. However, since the assessment scores to student understanding are obtained subjectively, the distribution of the understanding scores tends to be biased toward extremely high scores; consequently the assumption of the relationship to simulation test scores would not be held. In this paper, we propose a method to automatically rate student understanding scores based on instructors' observation reports using supervised learning method.In order to evaluate our proposed method, we conducted experiments on real data provided by a cram school. In the experiments, we estimate simulation test scores on a students' 60-point math exam using student understanding scores rated by our proposed method and those manually rated by instructors for comparison. The results of experiments show that the MAE between the understanding scores rated by our proposed method and those manually rated by the instructors were 7.81 and 8.73, respectively, which indicates that our proposed model significantly improve rating of the level of student understanding to learning in mathematics.

Original languageEnglish
Title of host publicationProceedings - 2022 12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022
EditorsTokuro Matsuo, Kunihiko Takamatsu, Yuichi Ono
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages224-229
Number of pages6
ISBN (Electronic)9781665497558
DOIs
Publication statusPublished - 2022
Event12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022 - Kanazawa, Japan
Duration: Jul 2 2022Jul 7 2022

Publication series

NameProceedings - 2022 12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022

Conference

Conference12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022
Country/TerritoryJapan
CityKanazawa
Period7/2/227/7/22

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems
  • Information Systems and Management
  • Decision Sciences (miscellaneous)

Fingerprint

Dive into the research topics of 'Automatic assessment of student understanding for estimateing test score'. Together they form a unique fingerprint.

Cite this