Review Correctness Prediction

Assume that a student incorrectly responds to an exercise $e_{\mathrm{rev}}$ and receives corresponding feedback. The goal of review correctness prediction (RC) is to predict whether a student will be able to respond to the exercise $e_{\mathrm{rev}}$ correctly or not if she encounters the exercise again. The significance of this AIEd task is that it can assess the educational effect of an exercise to a particular student in a specific situation. In particular, the correctness probability estimated by this task represents the student’s expected marginal gain in knowledge as she goes through future learning process. For example, if the correctness probability is high, it is likely that the student will obtain relevant knowledge in future even if his initial response was incorrect.

         Part            5    6    7         
  ------------------ -- ---- ---- ---- -- -- --
   Time limit (sec)      25   50   55        

  : Time Limits[]{data-label="tab:timelimit"}

Dataset
-------

We use the public *EdNet* dataset obtained from *Santa*, a mobile AI tutoring service for preparing TOEIC Listening and Reading Test [@choi2019ednet]. The test consists of two timed sections named Listening Comprehension (LC) and Reading Comprehension (RC) with a total of 100 exercises and 4 or 3 parts respectively. The final test score 