Image de couverture de livre

Relational Knowledge Distillation Using Fine-tuned Function Vectors

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kang, Andrea, Wu, Yingnian, Lu, Hongjing
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
par: Hościłowicz, Jakub, et autres
Publié: (2023)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
par: Zhou, Huichi, et autres
Publié: (2025)

Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
par: Li, Dongyue, et autres
Publié: (2025)

Fine-tuning and Prompt Engineering with Cognitive Knowledge Graphs for Scholarly Knowledge Organization
par: Rabby, Gollam, et autres
Publié: (2024)

EpilepsyLLM: Domain-Specific Large Language Model Fine-tuned with Epilepsy Medical Knowledge
par: Zhao, Xuyang, et autres
Publié: (2024)

Advancing Parameter Efficiency in Fine-tuning via Representation Editing
par: Wu, Muling, et autres
Publié: (2024)

Multimodal Function Vectors for Visual Relations
par: Fu, Shuhao, et autres
Publié: (2025)

LoCa: Logit Calibration for Knowledge Distillation
par: Yang, Runming, et autres
Publié: (2024)

Fine-tuning Large Language Models for Domain-specific Machine Translation
par: Zheng, Jiawei, et autres
Publié: (2024)

Learn Hard Problems During RL with Reference Guided Fine-tuning
par: Wu, Yangzhen, et autres
Publié: (2026)

Outlier-weighed Layerwise Sampling for LLM Fine-tuning
par: Li, Pengxiang, et autres
Publié: (2024)

Scalable Fine-tuning from Multiple Data Sources: A First-Order Approximation Approach
par: Li, Dongyue, et autres
Publié: (2024)

Sinkhorn Distance Minimization for Knowledge Distillation
par: Cui, Xiao, et autres
Publié: (2024)

Topic Modeling with Fine-tuning LLMs and Bag of Sentences
par: Schneider, Johannes
Publié: (2024)

SEE: Continual Fine-tuning with Sequential Ensemble of Experts
par: Wang, Zhilin, et autres
Publié: (2025)

On the Loss of Context-awareness in General Instruction Fine-tuning
par: Wang, Yihan, et autres
Publié: (2024)

$\textit{New News}$: System-2 Fine-tuning for Robust Integration of New Knowledge
par: Park, Core Francisco, et autres
Publié: (2025)

Delta Knowledge Distillation for Large Language Models
par: Cao, Yihan, et autres
Publié: (2025)

Distilling Multi-Scale Knowledge for Event Temporal Relation Extraction
par: Yao, Hao-Ren, et autres
Publié: (2022)

Whispering in Amharic: Fine-tuning Whisper for Low-resource Language
par: Gete, Dawit Ketema, et autres
Publié: (2025)

LoRA vs Full Fine-tuning: An Illusion of Equivalence
par: Shuttleworth, Reece, et autres
Publié: (2024)

PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning
par: Wang, Qibin, et autres
Publié: (2024)

Knowledge Distillation with Training Wheels
par: Liu, Guanlin, et autres
Publié: (2025)

Knowledge Distillation and Dataset Distillation of Large Language Models: Emerging Trends, Challenges, and Future Directions
par: Fang, Luyang, et autres
Publié: (2025)

Mechanistic Fine-tuning for In-context Learning
par: Cho, Hakaze, et autres
Publié: (2025)

What Makes and Breaks Safety Fine-tuning? A Mechanistic Study
par: Jain, Samyak, et autres
Publié: (2024)

A General Framework to Enhance Fine-tuning-based LLM Unlearning
par: Ren, Jie, et autres
Publié: (2025)

Improving Sampling Methods for Fine-tuning SentenceBERT in Text Streams
par: Garcia, Cristiano Mesquita, et autres
Publié: (2024)

Automatic Pruning of Fine-tuning Datasets for Transformer-based Language Models
par: Tayaranian, Mohammadreza, et autres
Publié: (2024)

Two-stage LLM Fine-tuning with Less Specialization and More Generalization
par: Wang, Yihan, et autres
Publié: (2022)

HarmAug: Effective Data Augmentation for Knowledge Distillation of Safety Guard Models
par: Lee, Seanie, et autres
Publié: (2024)

Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective
par: Ghosh, Bishwamittra, et autres
Publié: (2026)

GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning
par: Solatorio, Aivin V.
Publié: (2024)

RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture
par: Balaguer, Angels, et autres
Publié: (2024)

RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models
par: Najafi, Saeed, et autres
Publié: (2024)

Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation
par: Sengupta, Ayan, et autres
Publié: (2024)

Financial Sentiment Analysis: Leveraging Actual and Synthetic Data for Supervised Fine-tuning
par: Atsiwo, Abraham
Publié: (2024)

Personalized Federated Fine-tuning for Heterogeneous Data: An Automatic Rank Learning Approach via Two-Level LoRA
par: Hao, Jie, et autres
Publié: (2025)

LaFFi: Leveraging Hybrid Natural Language Feedback for Fine-tuning Language Models
par: Li, Qianxi, et autres
Publié: (2023)

Function Vectors in Large Language Models
par: Todd, Eric, et autres
Publié: (2023)