Authors
Andreea Dutulescu, Stefan Ruseti, Denis Iorga, Mihai Dascalu, Danielle S McNamara
Publication date
2024/7/2
Book
International Conference on Artificial Intelligence in Education
Pages
242-250
Publisher
Springer Nature Switzerland
Description
The process of generating challenging and appropriate distractors for multiple-choice questions is a complex and time-consuming task. Existing methods for an automated generation have limitations in proposing challenging distractors, or they fail to effectively filter out incorrect choices that closely resemble the correct answer, share synonymous meanings, or imply the same information. To overcome these challenges, we propose a comprehensive toolkit that integrates various approaches for generating distractors, including leveraging a general knowledge base and employing a T5 LLM. Additionally, we introduce a novel strategy that utilizes natural language inference to increase the accuracy of the generated distractors by removing confusing options. Our models have zero-shot capabilities and achieve good results on the DGen dataset; moreover, the models were fine-tuned and outperformed state-of-the-art …
Scholar articles
A Dutulescu, S Ruseti, D Iorga, M Dascalu… - International Conference on Artificial Intelligence in …, 2024