Cover Image

Optimizing LLM Annotation of Classroom Discourse through Multi-Agent Orchestration

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ahtisham, Bakhtawar, Vanacore, Kirk, Kizilcec, Rene F.
Format:	Preprint
Published:	2026
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AI Annotation Orchestration: Evaluating LLM verifiers to Improve the Quality of LLM Annotations in Learning Analytics
by: Ahtisham, Bakhtawar, et al.
Published: (2025)

Domain-Adapted Retrieval for In-Context Annotation of Pedagogical Dialogue Acts
by: Lee, Jinsook, et al.
Published: (2026)

Codebook-Injected Dialogue Segmentation for Multi-Utterance Constructs Annotation: LLM-Assisted and Gold-Label-Free Evaluation
by: Lee, Jinsook, et al.
Published: (2026)

LLM Reasoning Predicts When Models Are Right: Evidence from Coding Classroom Discourse
by: Ahtisham, Bakhtawar, et al.
Published: (2026)

Sandpiper: Orchestrated AI-Annotation for Educational Discourse at Scale
by: Hedley, Daryl, et al.
Published: (2026)

How well do Large Language Models Recognize Instructional Moves? Establishing Baselines for Foundation Models in Educational Discourse
by: Vanacore, Kirk, et al.
Published: (2025)

Utility-Preserving De-Identification for Math Tutoring: Investigating Numeric Ambiguity in the MathEd-PII Benchmark Dataset
by: Zhou, Zhuqian, et al.
Published: (2026)

OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaboration
by: Zhang, Jusheng, et al.
Published: (2025)

Million Tutoring Moves (MTM): An Open Multimodal Dataset for the Science of Tutoring
by: Kizilcec, René, et al.
Published: (2026)

Recognize Your Orchestrator: An Entropy Dynamics Perspective for LLM Multi-Agent Systems
by: Zhu, Junze, et al.
Published: (2026)

Cultural Bias and Cultural Alignment of Large Language Models
by: Tao, Yan, et al.
Published: (2023)

Beyond the Strongest LLM: Multi-Turn Multi-Agent Orchestration vs. Single LLMs on Benchmarks
by: Tian, Aaron Xuxiang, et al.
Published: (2025)

Emergent Convergence in Multi-Agent LLM Annotation
by: Parfenova, Angelina, et al.
Published: (2025)

Gradientsys: A Multi-Agent LLM Scheduler with ReAct Orchestration
by: Song, Xinyuan, et al.
Published: (2025)

Enhancing Science Classroom Discourse Analysis through Joint Multi-Task Learning for Reasoning-Component Classification
by: Noh, Jiho, et al.
Published: (2026)

HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM Systems
by: Hou, Zhipeng, et al.
Published: (2025)

Utility-Guided Agent Orchestration for Efficient LLM Tool Use
by: Liu, Boyan, et al.
Published: (2026)

AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration
by: Tian, Chunhao, et al.
Published: (2025)

AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol
by: Zhang, Wentao, et al.
Published: (2025)

Bayesian Orchestration of Multi-LLM Agents for Cost-Aware Sequential Decision-Making
by: Amin, Danial
Published: (2026)

MCP-Orchestrated Multi-Agent System for Automated Disinformation Detection
by: Avram, Alexandru-Andrei, et al.
Published: (2025)

Prompting Implicit Discourse Relation Annotation
by: Yung, Frances, et al.
Published: (2024)

Z-Space: A Multi-Agent Tool Orchestration Framework for Enterprise-Grade LLM Automation
by: He, Qingsong, et al.
Published: (2025)

Student Engagement in AI Assisted Complex Problem Solving: A Pilot Study of Human AI Rubik's Cube Collaboration
by: Vanacore, Kirk, et al.
Published: (2025)

Tutor Move Taxonomy: A Theory-Aligned Framework for Analyzing Instructional Moves in Tutoring
by: Zhou, Zhuqian, et al.
Published: (2026)

CrowdAgent: Multi-Agent Managed Multi-Source Annotation System
by: Qin, Maosheng, et al.
Published: (2025)

OMNI-LEAK: Orchestrator Multi-Agent Network Induced Data Leakage
by: Naik, Akshat, et al.
Published: (2026)

DOVA: Deliberation-First Multi-Agent Orchestration for Autonomous Research Automation
by: Shen, Aaron, et al.
Published: (2026)

Towards Scalable Lightweight GUI Agents via Multi-role Orchestration
by: Wang, Ziwei, et al.
Published: (2026)

Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows
by: Su, Jinwei, et al.
Published: (2025)

A Safety-Aware Role-Orchestrated Multi-Agent LLM Framework for Behavioral Health Communication Simulation
by: Cho, Ha Na
Published: (2026)

COSMO-Agent: Tool-Augmented Agent for Closed-loop Optimization,Simulation,and Modeling Orchestration
by: Deng, Liyuan, et al.
Published: (2026)

Tool-Augmented Agent for Closed-loop Optimization,Simulation,and Modeling Orchestration
by: Deng, Liyuan, et al.
Published: (2026)

Orchestrator Multi-Agent Clinical Decision Support System for Secondary Headache Diagnosis in Primary Care
by: Wu, Xizhi, et al.
Published: (2025)

Multi-Agent Collaboration via Evolving Orchestration
by: Dang, Yufan, et al.
Published: (2025)

Knots: A Large-Scale Multi-Agent Enhanced Expert-Annotated Dataset and LLM Prompt Optimization for NOTAM Semantic Parsing
by: Liu, Maoqi, et al.
Published: (2025)

LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learning
by: Chen, Xudong, et al.
Published: (2026)

Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Prompts
by: Li, Sha, et al.
Published: (2026)

Investigating Student Interaction Patterns with Large Language Model-Powered Course Assistants in Computer Science Courses
by: Liu, Chang, et al.
Published: (2025)

The Orchestration of Multi-Agent Systems: Architectures, Protocols, and Enterprise Adoption
by: Adimulam, Apoorva, et al.
Published: (2026)