Automatic Evaluation of Students’ Learning Experience Based on Their Freely-Written Comments

Jihed Makhlouf, Tsunenori Mine

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Understanding individual students more efficiently is an essential step for educational institutions to improve their services. Constantly tracking students’ learning situations is an important but challenging task. This step is becoming easier thanks to the advances in educational technology. In fact, educational data can be gathered and analyzed more easily due to the implementation and development of multiple educational software systems. It is in this context that we conducted a study to predict the students’ learning experience using a questionnaire. After each lesson, we give the students a questionnaire containing 5 predefined questions relative to their learning activities following the PCN method. Then, students provide their freely-written comments answering these questions. We use these comments to predict their learning experience in an approach to provide meaningful insights to the professor for better interventions. We built models that predict the students’ learning experience using textual data. We investigated 2 approaches to building the models. The baseline approach is to treat all comments of all the questions together. In the second approach, we feed the context of the question to the prediction model using a simple padding technique. Experimental results show that including the context of the question provided a significant improvement in the models prediction performances, attaining an F1-score of 0.74.

Original languageEnglish
Title of host publicationComputer Supported Education - 12th International Conference, CSEDU 2020, Revised Selected Papers
EditorsH. Chad Lane, Susan Zvacek, James Uhomoibhi
PublisherSpringer Science and Business Media Deutschland GmbH
Pages480-495
Number of pages16
ISBN (Print)9783030864385
DOIs
Publication statusPublished - 2021
Event12th International Conference on Computer Supported Education, CSEDU 2020 - Virtual, Online
Duration: May 2 2020May 4 2020

Publication series

NameCommunications in Computer and Information Science
Volume1473 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference12th International Conference on Computer Supported Education, CSEDU 2020
CityVirtual, Online
Period5/2/205/4/20

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Mathematics(all)

Fingerprint

Dive into the research topics of 'Automatic Evaluation of Students’ Learning Experience Based on Their Freely-Written Comments'. Together they form a unique fingerprint.

Cite this