Cover Image

LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Luccioli, Viviana, Iyengar, Rithika, Panley, Ryan, Haberkorn, Flora, Ge, Xiaoyu, Crane, Leland, Sinha, Nitish, Lee, Seung Jung
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale
by: Di Palo, Flavio, et al.
Published: (2024)

Efficacy of AI RAG Tools for Complex Information Extraction and Data Annotation Tasks: A Case Study Using Banks Public Disclosures
by: Botti, Nicholas, et al.
Published: (2025)

Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels
by: Pangakis, Nicholas, et al.
Published: (2024)

Deep Active Learning for Data Mining from Conflict Text Corpora
by: Croicu, Mihai
Published: (2024)

AI Brown and AI Koditex: LLM-Generated Corpora Comparable to Traditional Corpora of English and Czech Texts
by: Milička, Jiří, et al.
Published: (2025)

Deutsch als Zweitsprache und inklusive Bildung (2023)
by: Patricia E. Haberkorn
Published: (2025)

PLANIFICACIÓN ESTRATÉGICA Y POLÍTICAS PÚBLICAS. UN ANÁLISIS COMPARADO DE TRES PLANES ESTRATÉGICOS EN EL PERIODO DE POSTCONVERTIBILIDAD
by: María José Haberkorn
Published: (2016)

Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
by: Sinha, Yash, et al.
Published: (2023)

CFIR: Fast and Effective Long-Text To Image Retrieval for Large Corpora
by: Long, Zijun, et al.
Published: (2024)

Individual Text Corpora Predict Openness, Interests, Knowledge and Level of Education
by: Hofmann, Markus J., et al.
Published: (2024)

SpiroActive: Active Learning for Efficient Data Acquisition for Spirometry
by: Jain, Ankita Kumari, et al.
Published: (2024)

KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server
by: Wang, Wenhao, et al.
Published: (2024)

Explainable Knowledge Distillation for Efficient Medical Image Classification
by: Mir, Aqib Nazir, et al.
Published: (2025)

Active Learning for Multilingual Fingerspelling Corpora
by: Wang, Shuai, et al.
Published: (2023)

LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphs
by: Roy, Amit, et al.
Published: (2025)

LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification
by: Song, Yiping, et al.
Published: (2024)

On the Hardness of Approximating Distributions with Tractable Probabilistic Models
by: Leland, John, et al.
Published: (2025)

Adaptive Knowledge Distillation using a Device-Aware Teacher for Low-Complexity Acoustic Scene Classification
by: Jeong, Seung Gyu, et al.
Published: (2025)

KDH-MLTC: Knowledge Distillation for Healthcare Multi-Label Text Classification
by: Sakai, Hajar, et al.
Published: (2025)

Leveraging Procedural Knowledge and Task Hierarchies for Efficient Instructional Video Pre-training
by: Samel, Karan, et al.
Published: (2025)

Is This Collection Worth My LLM's Time? Automatically Measuring Information Potential in Text Corpora
by: Karch, Tristan, et al.
Published: (2025)

Building Trust in the Skies: A Knowledge-Grounded LLM-based Framework for Aviation Safety
by: Iyengar, Anirudh, et al.
Published: (2026)

Object Classification Utilizing Neuromorphic Proprioceptive Signals in Active Exploration: Validated on a Soft Anthropomorphic Hand
by: Wang, Fengyi, et al.
Published: (2025)

Uncertainty-Aware Dual-Student Knowledge Distillation for Efficient Image Classification
by: Gore, Aakash, et al.
Published: (2025)

Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification
by: Guo, Chenqi, et al.
Published: (2025)

Multilingual and Explainable Text Detoxification with Parallel Corpora
by: Dementieva, Daryna, et al.
Published: (2024)

Stiffness measurements for direct-shear apparatuses
by: Ikari, Matt J, et al.
Published: (2022)

TrajLLM: A Modular LLM-Enhanced Agent-Based Framework for Realistic Human Trajectory Simulation
by: Ju, Chenlu, et al.
Published: (2025)

Ingeniería económica // Leland Blank, Anthony Tarquin ; Trad. Javier Enriquez Brito
by: Blank, Leland
Published: (2002)

Mountain-Plains Curriculum Package. Home Management.
by: Leland, L.
Published: (1975)

The Sense of Agency in Assistive Robotics Using Shared Autonomy
by: Collier, Maggie A., et al.
Published: (2025)

Enhancing Text Classification through LLM-Driven Active Learning and Human Annotation
by: Rouzegar, Hamidreza, et al.
Published: (2024)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
by: Yang, Runming, et al.
Published: (2024)

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models
by: Lee, Hanna, et al.
Published: (2026)

MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
by: Udayangani, Nilushika, et al.
Published: (2026)

HDKD: Hybrid Data-Efficient Knowledge Distillation Network for Medical Image Classification
by: EL-Assiouti, Omar S., et al.
Published: (2024)

KD-OCT: Efficient Knowledge Distillation for Clinical-Grade Retinal OCT Classification
by: Nourbakhsh, Erfan, et al.
Published: (2025)

AgriKD: Cross-Architecture Knowledge Distillation for Efficient Leaf Disease Classification
by: Le, Minh-Dung, et al.
Published: (2026)

Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference
by: Sabry, Mohammed, et al.
Published: (2026)

Active Hypothesis Testing under Computational Budgets with Applications to GWAS and LLM
by: Kuang, Qi, et al.
Published: (2025)