Imagen de Portada

Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xia, Mingxuan, Wang, Haobo, Li, Yixuan, Yu, Zewei, Wang, Jindong, Zhao, Junbo, Wu, Runze
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts
por: Wang, Xinyi, et al.
Publicado: (2025)

Steer LLM Latents for Hallucination Detection
por: Park, Seongheon, et al.
Publicado: (2025)

Strong Teacher Not Needed? On Distillation in LLM Pretraining
por: Lu, Taiming, et al.
Publicado: (2026)

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression
por: Pan, Zhuoshi, et al.
Publicado: (2024)

Towards Robust Incremental Learning under Ambiguous Supervision
por: Wang, Rui, et al.
Publicado: (2025)

Green Prompting: Characterizing Prompt-driven Energy Costs of LLM Inference
por: Adamska, Marta, et al.
Publicado: (2025)

PromptBench: A Unified Library for Evaluation of Large Language Models
por: Zhu, Kaijie, et al.
Publicado: (2023)

Rebellious Student: Reversing Teacher Signals for Reasoning Exploration with Self-Distilled RLVR
por: Kim, Jeonghye, et al.
Publicado: (2026)

DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI
por: Liang, Hao, et al.
Publicado: (2025)

Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels
por: Pangakis, Nicholas, et al.
Publicado: (2024)

HawkesLLM: Semantic Uncertainty Propagation in Agentic Text Simulation
por: Deng, Zewei, et al.
Publicado: (2026)

Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information
por: Shen, Guobin, et al.
Publicado: (2026)

Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation
por: Zhang, Hengyuan, et al.
Publicado: (2025)

How Can Large Language Models Understand Spatial-Temporal Data?
por: Liu, Lei, et al.
Publicado: (2024)

UniSD: Towards a Unified Self-Distillation Framework for Large Language Models
por: Jin, Yiqiao, et al.
Publicado: (2026)

PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
por: Kim, Gyeongman, et al.
Publicado: (2024)

BitNet Distillation
por: Wu, Xun, et al.
Publicado: (2025)

From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment
por: Chen, Hao, et al.
Publicado: (2026)

Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks
por: Li, Miaomiao, et al.
Publicado: (2025)

Automatic Prompt Optimization with Prompt Distillation
por: Dyagin, Ernest A., et al.
Publicado: (2025)

Reinforcement Learning-based Knowledge Distillation with LLM-as-a-Judge
por: Shen, Yiyang, et al.
Publicado: (2026)

SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization
por: Zhang, Taolin, et al.
Publicado: (2026)

PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
por: Zhu, Kaijie, et al.
Publicado: (2023)

Energy-based Automated Model Evaluation
por: Peng, Ru, et al.
Publicado: (2024)

From Variance to Invariance: Qualitative Content Analysis for Narrative Graph Annotation
por: Huang, Junbo, et al.
Publicado: (2026)

In Good GRACEs: Principled Teacher Selection for Knowledge Distillation
por: Panigrahi, Abhishek, et al.
Publicado: (2025)

CultureLLM: Incorporating Cultural Differences into Large Language Models
por: Li, Cheng, et al.
Publicado: (2024)

Merge-of-Thought Distillation
por: Shen, Zhanming, et al.
Publicado: (2025)

YODA: Teacher-Student Progressive Learning for Language Models
por: Lu, Jianqiao, et al.
Publicado: (2024)

LLM Prompt Duel Optimizer: Efficient Label-Free Prompt Optimization
por: Wu, Yuanchen, et al.
Publicado: (2025)

CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency
por: Shen, Zhanming, et al.
Publicado: (2025)

Optimal Brain Iterative Merging: Mitigating Interference in LLM Merging
por: Wang, Zhixiang, et al.
Publicado: (2025)

ProCut: LLM Prompt Compression via Attribution Estimation
por: Xu, Zhentao, et al.
Publicado: (2025)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
por: Yang, Runming, et al.
Publicado: (2024)

Summarize-Exemplify-Reflect: Data-driven Insight Distillation Empowers LLMs for Few-shot Tabular Classification
por: Yuan, Yifei, et al.
Publicado: (2025)

On Teacher Hacking in Language Model Distillation
por: Tiapkin, Daniil, et al.
Publicado: (2025)

DataEnvGym: Data Generation Agents in Teacher Environments with Student Feedback
por: Khan, Zaid, et al.
Publicado: (2024)

Prompt Curriculum Learning for Efficient LLM Post-Training
por: Gao, Zhaolin, et al.
Publicado: (2025)

On Limitations of LLM as Annotator for Low Resource Languages
por: Jadhav, Suramya, et al.
Publicado: (2024)

Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programs
por: Liu, Haoyue, et al.
Publicado: (2026)