TY - GEN
T1 - Automatic assessment of student understanding for estimateing test score
AU - Ueno, Kyouhei
AU - Mine, Tsunenori
N1 - Funding Information:
This work was supported in part by e-sia Corporation and by Grant-in-Aid for Scientific Research proposal numbers: JP21H00907, JP20H01728, JP20H04300, and JP19KK0257.
Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Prediction of the level of student understanding to learning is one of crucial issues in education. The level of understating is usually estimated by simulation test scores from the assumption that there is a strong relationship between the level of understanding and a simulation test score. Meanwhile, instructors or teachers often assess student understanding by observing their learning status and use the assessment scores to give the students feedback. However, since the assessment scores to student understanding are obtained subjectively, the distribution of the understanding scores tends to be biased toward extremely high scores; consequently the assumption of the relationship to simulation test scores would not be held. In this paper, we propose a method to automatically rate student understanding scores based on instructors' observation reports using supervised learning method.In order to evaluate our proposed method, we conducted experiments on real data provided by a cram school. In the experiments, we estimate simulation test scores on a students' 60-point math exam using student understanding scores rated by our proposed method and those manually rated by instructors for comparison. The results of experiments show that the MAE between the understanding scores rated by our proposed method and those manually rated by the instructors were 7.81 and 8.73, respectively, which indicates that our proposed model significantly improve rating of the level of student understanding to learning in mathematics.
AB - Prediction of the level of student understanding to learning is one of crucial issues in education. The level of understating is usually estimated by simulation test scores from the assumption that there is a strong relationship between the level of understanding and a simulation test score. Meanwhile, instructors or teachers often assess student understanding by observing their learning status and use the assessment scores to give the students feedback. However, since the assessment scores to student understanding are obtained subjectively, the distribution of the understanding scores tends to be biased toward extremely high scores; consequently the assumption of the relationship to simulation test scores would not be held. In this paper, we propose a method to automatically rate student understanding scores based on instructors' observation reports using supervised learning method.In order to evaluate our proposed method, we conducted experiments on real data provided by a cram school. In the experiments, we estimate simulation test scores on a students' 60-point math exam using student understanding scores rated by our proposed method and those manually rated by instructors for comparison. The results of experiments show that the MAE between the understanding scores rated by our proposed method and those manually rated by the instructors were 7.81 and 8.73, respectively, which indicates that our proposed model significantly improve rating of the level of student understanding to learning in mathematics.
UR - http://www.scopus.com/inward/record.url?scp=85139557783&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85139557783&partnerID=8YFLogxK
U2 - 10.1109/IIAIAAI55812.2022.00052
DO - 10.1109/IIAIAAI55812.2022.00052
M3 - Conference contribution
AN - SCOPUS:85139557783
T3 - Proceedings - 2022 12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022
SP - 224
EP - 229
BT - Proceedings - 2022 12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022
A2 - Matsuo, Tokuro
A2 - Takamatsu, Kunihiko
A2 - Ono, Yuichi
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 12th International Congress on Advanced Applied Informatics, IIAI-AAI 2022
Y2 - 2 July 2022 through 7 July 2022
ER -