Cover Image

Sandpiper: Orchestrated AI-Annotation for Educational Discourse at Scale

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hedley, Daryl, Pietrzak, Doug, Dias, Jorge, Burden, Ian, Ahtisham, Bakhtawar, Zhou, Zhuqian, Vanacore, Kirk, Marland, Josh, Slama, Rachel, Reich, Justin, Koedinger, Kenneth, Kizilcec, René
Format:	Preprint
Published:	2026
Subjects:	Human-Computer Interaction Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Million Tutoring Moves (MTM): An Open Multimodal Dataset for the Science of Tutoring
by: Kizilcec, René, et al.
Published: (2026)

AI Annotation Orchestration: Evaluating LLM verifiers to Improve the Quality of LLM Annotations in Learning Analytics
by: Ahtisham, Bakhtawar, et al.
Published: (2025)

Optimizing LLM Annotation of Classroom Discourse through Multi-Agent Orchestration
by: Ahtisham, Bakhtawar, et al.
Published: (2026)

LLM Reasoning Predicts When Models Are Right: Evidence from Coding Classroom Discourse
by: Ahtisham, Bakhtawar, et al.
Published: (2026)

Domain-Adapted Retrieval for In-Context Annotation of Pedagogical Dialogue Acts
by: Lee, Jinsook, et al.
Published: (2026)

Utility-Preserving De-Identification for Math Tutoring: Investigating Numeric Ambiguity in the MathEd-PII Benchmark Dataset
by: Zhou, Zhuqian, et al.
Published: (2026)

Codebook-Injected Dialogue Segmentation for Multi-Utterance Constructs Annotation: LLM-Assisted and Gold-Label-Free Evaluation
by: Lee, Jinsook, et al.
Published: (2026)

How well do Large Language Models Recognize Instructional Moves? Establishing Baselines for Foundation Models in Educational Discourse
by: Vanacore, Kirk, et al.
Published: (2025)

Tutor Move Taxonomy: A Theory-Aligned Framework for Analyzing Instructional Moves in Tutoring
by: Zhou, Zhuqian, et al.
Published: (2026)

Modernizing Ground Truth: Four Shifts Toward Improving Reliability and Validity in AI in Education
by: Thomas, Danielle R., et al.
Published: (2026)

Does the TalkMoves Codebook Generalize to One-on-One Tutoring and Multimodal Interaction?
by: Focsan, Corina Luca, et al.
Published: (2026)

Shiksha Copilot: Teacher-AI Collaboration for Curating and Customizing Lesson Plans in Low-Resource Schools
by: Dennison, Deepak Varuvel, et al.
Published: (2025)

Beyond Agreement: Rethinking Ground Truth in Educational AI Annotation
by: Thomas, Danielle R., et al.
Published: (2025)

Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment
by: Borchers, Conrad, et al.
Published: (2025)

Reflection on Purpose Changes Students' Academic Interests: A Scalable Intervention in an Online Course Catalog
by: Chen, Youjie, et al.
Published: (2024)

The Path to Conversational AI Tutors: Integrating Tutoring Best Practices and Targeted Technologies to Produce Scalable AI Agents
by: Vanacore, Kirk, et al.
Published: (2026)

Leveraging Large Language Models for Identifying Knowledge Components
by: Wang, Canwen, et al.
Published: (2025)

A Framework for Auditing Chatbots for Dialect-Based Quality-of-Service Harms
by: Harvey, Emma, et al.
Published: (2025)

"Don't Forget the Teachers": Towards an Educator-Centered Understanding of Harms from Large Language Models in Education
by: Harvey, Emma, et al.
Published: (2025)

Who Decides in AI-Mediated Learning? The Agency Allocation Framework
by: Borchers, Conrad, et al.
Published: (2026)

Not Everyone Wins with LLMs: Behavioral Patterns and Pedagogical Implications for AI Literacy in Programmatic Data Science
by: Ma, Qianou, et al.
Published: (2025)

Educational Technology--A Vote of Confidence.
by: Marland, S. P., Jr.
Published: (1972)

Does Algorithmic Uncertainty Sway Human Experts? Evidence from a Field Experiment in Selective College Admissions
by: Lee, Hansol, et al.
Published: (2026)

Poor Alignment and Steerability of Large Language Models: Evidence from College Admission Essays
by: Lee, Jinsook, et al.
Published: (2025)

System X: A Mobile Voice-Based AI System for EMR Generation and Clinical Decision Support in Low-Resource Maternal Healthcare
by: Mustafa, Maryam, et al.
Published: (2025)

GPTutor: Great Personalized Tutor with Large Language Models for Personalized Learning Content Generation
by: Chen, Eason, et al.
Published: (2024)

Automatic Alignment of Discourse Relations of Different Discourse Annotation Frameworks
by: Fu, Yingxue
Published: (2024)

The Life Cycle of Large Language Models: A Review of Biases in Education
by: Lee, Jinsook, et al.
Published: (2024)

Cultural Bias and Cultural Alignment of Large Language Models
by: Tao, Yan, et al.
Published: (2023)

Evaluating AI Evaluation: Perils and Prospects
by: Burden, John
Published: (2024)

Investigating Student Interaction Patterns with Large Language Model-Powered Course Assistants in Computer Science Courses
by: Liu, Chang, et al.
Published: (2025)

On Crowdsourcing Task Design for Discourse Relation Annotation
by: Yung, Frances, et al.
Published: (2024)

Student Engagement in AI Assisted Complex Problem Solving: A Pilot Study of Human AI Rubik's Cube Collaboration
by: Vanacore, Kirk, et al.
Published: (2025)

Fundamental Mechanisms of Human Learning: Implications for Research and Practice in Education
by: Allen, Scott E., et al.
Published: (2025)

How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging
by: Ma, Qianou, et al.
Published: (2023)

Prompting Implicit Discourse Relation Annotation
by: Yung, Frances, et al.
Published: (2024)

The Digital Divide in Generative AI: Evidence from Large Language Model Use in College Admissions Essays
by: Lee, Jinsook, et al.
Published: (2026)

When the Past Misleads: Rethinking Training Data Expansion Under Temporal Distribution Shifts
by: Yao, Chengyuan, et al.
Published: (2025)

Fairness Hub Technical Briefs: Definition and Detection of Distribution Shift
by: Acevedo, Nicolas, et al.
Published: (2024)

AI2T: Building Trustable AI Tutors by Interactively Teaching a Self-Aware Learning Agent
by: Weitekamp, Daniel, et al.
Published: (2024)