EduCoder: An Open-Source Annotation System for Education Transcript Data

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ashraf, Saad, Malamut, James, Kumar, Vishal, Pan, Guanzhong, Nam, Hyunji, Tan, Mei, Langlois, Lucía, Deonizio, Liliana, Higgins, Helen, Demszky, Dorottya
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918481862066176
author Ashraf, Saad
Malamut, James
Kumar, Vishal
Pan, Guanzhong
Nam, Hyunji
Tan, Mei
Langlois, Lucía
Deonizio, Liliana
Higgins, Helen
Demszky, Dorottya
author_facet Ashraf, Saad
Malamut, James
Kumar, Vishal
Pan, Guanzhong
Nam, Hyunji
Tan, Mei
Langlois, Lucía
Deonizio, Liliana
Higgins, Helen
Demszky, Dorottya
contents We introduce EduCoder, a domain-specialized tool designed to support utterance-level annotation of educational dialogue. While general-purpose text annotation tools for NLP and qualitative research abound, few address the complexities of coding education dialogue transcripts -- with diverse teacher-student and peer interactions. Common challenges include defining codebooks for complex pedagogical features, supporting both open-ended and categorical coding, and contextualizing utterances with external features, such as the lesson's purpose and the pedagogical value of the instruction. EduCoder is designed to address these challenges by providing a platform for researchers and domain experts to collaboratively define complex codebooks based on observed data. It incorporates both categorical and open-ended annotation types along with contextual materials. Additionally, it offers a side-by-side comparison of multiple annotators' responses, allowing comparison and calibration of annotations with others to improve data reliability. The system is open-source, with a demo video available.
format Preprint
id arxiv_https___arxiv_org_abs_2507_05385
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EduCoder: An Open-Source Annotation System for Education Transcript Data
Ashraf, Saad
Malamut, James
Kumar, Vishal
Pan, Guanzhong
Nam, Hyunji
Tan, Mei
Langlois, Lucía
Deonizio, Liliana
Higgins, Helen
Demszky, Dorottya
Computation and Language
We introduce EduCoder, a domain-specialized tool designed to support utterance-level annotation of educational dialogue. While general-purpose text annotation tools for NLP and qualitative research abound, few address the complexities of coding education dialogue transcripts -- with diverse teacher-student and peer interactions. Common challenges include defining codebooks for complex pedagogical features, supporting both open-ended and categorical coding, and contextualizing utterances with external features, such as the lesson's purpose and the pedagogical value of the instruction. EduCoder is designed to address these challenges by providing a platform for researchers and domain experts to collaboratively define complex codebooks based on observed data. It incorporates both categorical and open-ended annotation types along with contextual materials. Additionally, it offers a side-by-side comparison of multiple annotators' responses, allowing comparison and calibration of annotations with others to improve data reliability. The system is open-source, with a demo video available.
title EduCoder: An Open-Source Annotation System for Education Transcript Data
topic Computation and Language
url https://arxiv.org/abs/2507.05385