Comparing multi-attempt quizzes between modules

This year Lancaster used a multi-attempt true-false quiz format in four large compulsory mathematics modules. We have written several variants for each true-false statement, and the quizzes are designed so that between student attempt the selection of variants changes. The idea is that the quizzes will motivate the student to persist until they have mastered the subject.

The results data from those quizzes allows one to indirectly measure interesting features, such as student learning gain, quiz difficulty, and student effort. Due to the similarity of the quiz formats between these four modules, it allows direct comparison of those features between the modules. Finally, I will describe how I am using this information to influence future improvements to our students’ education.

This talk is an update to the one I gave at EAMS 2022, when we only had one module that used quizzes in this format.