E-tests and evaluation surveys
LMS
SECONDARY
Every e-test consisted of 20 items with 10 items extracted from each questionnaire, A and B. Students could accomplish them in 10–15 min. They accessed the e-tests sequentially for one month, creating a spaced learning system. To qualify for the next e-test, students had to play at least one round of their previous MC-Duell questionnaire. For the secondary outcome, students filled in an evaluation survey simultaneously to pretest and posttest. It contained 18 items which they rated on a 4-point Likert scale, depending on how much they agreed to a given statement (1 = strongly disagree, 4 = strongly agree). The survey addressed the impact of EbM in their curriculum and later profession. It included self-assessment of their long-term retention in EbM and MC-Duell’s influence on it, how they perceived competition and the app’s effect on their motivation. In addition, students answered 3 free text questions. In the pretest, they described what they expected of MC-Duell. In the posttest, they drafted what they liked and what they thought could be improved. They further recorded their time investment per week, varying between “less than 1 h” to “over 10 h”. Students accessed e-tests, evaluation surveys and URLs to MC-Duell on the learning management system (LMS) Moodle.