Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerank
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917242386513920 |
|---|---|
| author | Mitton, Joshua Bhattacharyya, Prarthana Smith, Digory Christie, Thomas Abboud, Ralph Woodhead, Simon |
| author_facet | Mitton, Joshua Bhattacharyya, Prarthana Smith, Digory Christie, Thomas Abboud, Ralph Woodhead, Simon |
| contents | Timely and accurate identification of student misconceptions is key to improving learning outcomes and pre-empting the compounding of student errors. However, this task is highly dependent on the effort and intuition of the teacher. In this work, we present a novel approach for detecting misconceptions from student-tutor dialogues using large language models (LLMs). First, we use a fine-tuned LLM to generate plausible misconceptions, and then retrieve the most promising candidates among these using embedding similarity with the input dialogue. These candidates are then assessed and re-ranked by another fine-tuned LLM to improve misconception relevance. Empirically, we evaluate our system on real dialogues from an educational tutoring platform. We consider multiple base LLM models including LLaMA, Qwen and Claude on zero-shot and fine-tuned settings. We find that our approach improves predictive performance over baseline models and that fine-tuning improves both generated misconception quality and can outperform larger closed-source models. Finally, we conduct ablation studies to both validate the importance of our generation and reranking steps on misconception generation quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_02414 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerank Mitton, Joshua Bhattacharyya, Prarthana Smith, Digory Christie, Thomas Abboud, Ralph Woodhead, Simon Computation and Language Machine Learning Timely and accurate identification of student misconceptions is key to improving learning outcomes and pre-empting the compounding of student errors. However, this task is highly dependent on the effort and intuition of the teacher. In this work, we present a novel approach for detecting misconceptions from student-tutor dialogues using large language models (LLMs). First, we use a fine-tuned LLM to generate plausible misconceptions, and then retrieve the most promising candidates among these using embedding similarity with the input dialogue. These candidates are then assessed and re-ranked by another fine-tuned LLM to improve misconception relevance. Empirically, we evaluate our system on real dialogues from an educational tutoring platform. We consider multiple base LLM models including LLaMA, Qwen and Claude on zero-shot and fine-tuned settings. We find that our approach improves predictive performance over baseline models and that fine-tuning improves both generated misconception quality and can outperform larger closed-source models. Finally, we conduct ablation studies to both validate the importance of our generation and reranking steps on misconception generation quality. |
| title | Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerank |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2602.02414 |