Copertina

MEND: Meta dEmonstratioN Distillation for Efficient and Effective In-Context Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Yichuan, Ma, Xiyao, Lu, Sixing, Lee, Kyumin, Liu, Xiaohu, Guo, Chenlei
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Empowering Large Language Models for Textual Data Augmentation
di: Li, Yichuan, et al.
Pubblicazione: (2024)

PropMEND: Hypernetworks for Knowledge Propagation in LLMs
di: Liu, Zeyu Leo, et al.
Pubblicazione: (2025)

From Critique to Clarity: A Pathway to Faithful and Personalized Code Explanations with Large Language Models
di: Xu, Zexing, et al.
Pubblicazione: (2024)

STEPER: Step-wise Knowledge Distillation for Enhancing Reasoning Ability in Multi-Step Retrieval-Augmented Language Models
di: Lee, Kyumin, et al.
Pubblicazione: (2025)

Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification
di: Mou, Guanyi, et al.
Pubblicazione: (2024)

Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation
di: Zhou, Yuhang, et al.
Pubblicazione: (2024)

Piece of Table: A Divide-and-Conquer Approach for Selecting Subtables in Table Question Answering
di: Lee, Wonjin, et al.
Pubblicazione: (2024)

Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts
di: Chen, Yingfa, et al.
Pubblicazione: (2026)

Meta-Sel: Efficient Demonstration Selection for In-Context Learning via Supervised Meta-Learning
di: Wang, Xubin, et al.
Pubblicazione: (2026)

TSUBASA: Improving Long-Horizon Personalization via Evolving Memory and Self-Learning with Context Distillation
di: Zhang, Xinliang Frederick, et al.
Pubblicazione: (2026)

Quantity Convergence, Quality Divergence: Disentangling Fluency and Accuracy in L2 Mandarin Prosody
di: Shi, Yuqi, et al.
Pubblicazione: (2026)

END: Early Noise Dropping for Efficient and Effective Context Denoising
di: Jin, Hongye, et al.
Pubblicazione: (2025)

Beyond Perfect APIs: A Comprehensive Evaluation of LLM Agents Under Real-World API Complexity
di: Kim, Doyoung, et al.
Pubblicazione: (2026)

Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors
di: Li, Guozheng, et al.
Pubblicazione: (2024)

LAWCAT: Efficient Distillation from Quadratic to Linear Attention with Convolution across Tokens for Long Context Modeling
di: Liu, Zeyu, et al.
Pubblicazione: (2025)

From Deferral to Learning: Online In-Context Knowledge Distillation for LLM Cascades
di: Wu, Yu, et al.
Pubblicazione: (2025)

Context Memorization for Efficient Long Context Generation
di: Okoshi, Yasuyuki, et al.
Pubblicazione: (2026)

Evaluation of Coding Schemes for Transformer-based Gene Sequence Modeling
di: Gong, Chenlei, et al.
Pubblicazione: (2025)

MetaSICL: Adapting Audiroty LLM via Meta Speech In-Context Learning
di: Zheng, Haolong, et al.
Pubblicazione: (2026)

Distilling Monolingual and Crosslingual Word-in-Context Representations
di: Arase, Yuki, et al.
Pubblicazione: (2024)

Rapid Word Learning Through Meta In-Context Learning
di: Wang, Wentao, et al.
Pubblicazione: (2025)

EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models
di: Wang, Chengyu, et al.
Pubblicazione: (2025)

Efficient Text Classification with Conformal In-Context Learning
di: Pantelidis, Ippokratis, et al.
Pubblicazione: (2025)

EMSEdit: Efficient Multi-Step Meta-Learning-based Model Editing
di: Li, Xiaopeng, et al.
Pubblicazione: (2025)

Emojis Decoded: Leveraging ChatGPT for Enhanced Understanding in Social Media Communications
di: Zhou, Yuhang, et al.
Pubblicazione: (2024)

Context-level Language Modeling by Learning Predictive Context Embeddings
di: Dai, Beiya, et al.
Pubblicazione: (2025)

Distilling the Essence: Efficient Reasoning Distillation via Sequence Truncation
di: Chen, Wei-Rui, et al.
Pubblicazione: (2025)

EntropyLong: Effective Long-Context Training via Predictive Uncertainty
di: Jia, Junlong, et al.
Pubblicazione: (2025)

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models
di: Lee, Hanna, et al.
Pubblicazione: (2026)

Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergence
di: Minegishi, Gouki, et al.
Pubblicazione: (2025)

Timely Machine: Awareness of Time Makes Test-Time Scaling Agentic
di: Ma, Yichuan, et al.
Pubblicazione: (2026)

OPSDL: On-Policy Self-Distillation for Long-Context Language Models
di: Zhang, Xinsen, et al.
Pubblicazione: (2026)

Whispering Context: Distilling Syntax and Semantics for Long Speech Transcripts
di: Altinok, Duygu
Pubblicazione: (2025)

KV-Distill: Nearly Lossless Learnable Context Compression for LLMs
di: Chari, Vivek, et al.
Pubblicazione: (2025)

Effective Structured Prompting by Meta-Learning and Representative Verbalizer
di: Jiang, Weisen, et al.
Pubblicazione: (2023)

Efficiently Distilling LLMs for Edge Applications
di: Kundu, Achintya, et al.
Pubblicazione: (2024)

SkillFactory: Self-Distillation For Learning Cognitive Behaviors
di: Sprague, Zayne, et al.
Pubblicazione: (2025)

Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations
di: Wei, Zeming, et al.
Pubblicazione: (2023)

Sentinel: Decoding Context Utilization via Attention Probing for Efficient LLM Context Compression
di: Zhang, Yong, et al.
Pubblicazione: (2025)

Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation
di: Myung, Jiyoon, et al.
Pubblicazione: (2024)