:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Upadhayaya, Rajesh, Osti, Manish Raj, Smith, Zachary, Kottmyer, Chritopher
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2409.01930
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Modular Delta Merging with Orthogonal Constraints: A Scalable Framework for Continual and Reversible Model Composition
by: Khan, Haris, et al.
Published: (2025)

LLM-QFL: Distilling Large Language Model for Quantum Federated Learning
by: Gurung, Dev, et al.
Published: (2025)

An Efficient Long-Context Ranking Architecture With Calibrated LLM Distillation: Application to Person-Job Fit
by: Jouanneau, Warren, et al.
Published: (2026)

In-Context Data Distillation with TabPFN
by: Ma, Junwei, et al.
Published: (2024)

Dynamic Context Adaptation and Information Flow Control in Transformers: Introducing the Evaluator Adjuster Unit and Gated Residual Connections
by: Dhayalkar, Sahil Rajesh
Published: (2024)

DUET: Distilled LLM Unlearning from an Efficiently Contextualized Teacher
by: Zhong, Yisheng, et al.
Published: (2026)

Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning
by: Li, Chengye, et al.
Published: (2025)

One size doesn't fit all: Predicting the Number of Examples for In-Context Learning
by: Chandra, Manish, et al.
Published: (2024)

LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora
by: Luccioli, Viviana, et al.
Published: (2025)

Identity-Link IRT for Label-Free LLM Evaluation: Preserving Additivity in TVD-MI Scores
by: Robertson, Zachary
Published: (2025)

Context Distillation as Latent Memory Management
by: Zheng, Ziyang, et al.
Published: (2026)

Emergence of In-Context Reinforcement Learning from Noise Distillation
by: Zisman, Ilya, et al.
Published: (2023)

Memori: A Persistent Memory Layer for Efficient, Context-Aware LLM Agents
by: Borro, Luiz C., et al.
Published: (2026)

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
by: Ma, Xuezhe, et al.
Published: (2024)

Agent-Omit: Adaptive Context Omission for Efficient LLM Agents
by: Ning, Yansong, et al.
Published: (2026)

Attention and Compression is all you need for Controllably Efficient Language Models
by: Prakash, Jatin, et al.
Published: (2025)

Hamming Attention Distillation: Binarizing Keys and Queries for Efficient Long-Context Transformers
by: Horton, Mark, et al.
Published: (2025)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
by: Yang, Runming, et al.
Published: (2024)

Distillation Traps and Guards: A Calibration Knob for LLM Distillability
by: Zhan, Weixiao, et al.
Published: (2026)

Learning to Extract Context for Context-Aware LLM Inference
by: Kim, Minseon, et al.
Published: (2025)

Distilling Conversations: Abstract Compression of Conversational Audio Context for LLM-based ASR
by: Kumar, Shashi, et al.
Published: (2026)

Peeling Context from Cause for Molecular Property Prediction
by: Li, Tao, et al.
Published: (2025)

Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
by: Tang, Jiaming, et al.
Published: (2024)

LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
by: Fu, Qichen, et al.
Published: (2024)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
by: Xiao, Chaojun, et al.
Published: (2024)

Efficient Verified Machine Unlearning For Distillation
by: Quan, Yijun, et al.
Published: (2025)

PPG-Distill: Efficient Photoplethysmography Signals Analysis via Foundation Model Distillation
by: Ni, Juntong, et al.
Published: (2025)

Self Distillation via Iterative Constructive Perturbations
by: Dave, Maheak, et al.
Published: (2025)

Communication Efficient Adaptive Model-Driven Quantum Federated Learning
by: Gurung, Dev, et al.
Published: (2025)

Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts
by: Chen, Yingfa, et al.
Published: (2026)

Membership and Memorization in LLM Knowledge Distillation
by: Zhang, Ziqi, et al.
Published: (2025)

Apertus LLM Family Expansion via Distillation and Quantization
by: Panferov, Andrei, et al.
Published: (2026)

Latent Context Compilation: Distilling Long Context into Compact Portable Memory
by: Li, Zeju, et al.
Published: (2026)

LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
by: Xu, Junjie, et al.
Published: (2024)

Efficient Analysis of the Distilled Neural Tangent Kernel
by: Mahowald, Jamie, et al.
Published: (2026)

Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
by: Muhamed, Aashiq, et al.
Published: (2024)

Generative Diffusion Prior Distillation for Long-Context Knowledge Transfer
by: Udayangani, Nilushika, et al.
Published: (2026)

Distilling Reinforcement Learning Algorithms for In-Context Model-Based Planning
by: Son, Jaehyeon, et al.
Published: (2025)

Short Data, Long Context: Distilling Positional Knowledge in Transformers
by: Huber, Patrick, et al.
Published: (2026)

GATES: Self-Distillation under Privileged Context with Consensus Gating
by: Stein, Alex, et al.
Published: (2026)