Imagen de Portada

Parameter Efficient Instruction Tuning: An Empirical Study

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	He, Pengfei
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Parameter Efficient Multimodal Instruction Tuning for Romanian Vision Language Models
por: Dima, George-Andrei, et al.
Publicado: (2025)

Picky LLMs and Unreliable RMs: An Empirical Study on Safety Alignment after Instruction Tuning
por: Li, Guanlin, et al.
Publicado: (2025)

Federated Data-Efficient Instruction Tuning for Large Language Models
por: Qin, Zhen, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
por: Zhang, Dan, et al.
Publicado: (2025)

Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging
por: Hui, Tingfeng, et al.
Publicado: (2024)

What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning
por: Liu, Wei, et al.
Publicado: (2023)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
por: Gao, Ziqi, et al.
Publicado: (2024)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
por: Ren, Weijieying, et al.
Publicado: (2024)

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
por: Lingam, Vijay, et al.
Publicado: (2024)

Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications
por: Halfon, Alon, et al.
Publicado: (2024)

Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
por: Li, Ming, et al.
Publicado: (2024)

Contrastive Instruction Tuning
por: Yan, Tianyi Lorena, et al.
Publicado: (2024)

An Empirical Study on Preference Tuning Generalization and Diversity Under Domain Shift
por: Karouzos, Constantinos, et al.
Publicado: (2026)

Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications
por: Balne, Charith Chandra Sai, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
por: Wang, Luping, et al.
Publicado: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
por: Ma, Xinyu, et al.
Publicado: (2024)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
por: Pathak, Harsh Nilesh, et al.
Publicado: (2025)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
por: Zhou, Han, et al.
Publicado: (2023)

LongForm: Effective Instruction Tuning with Reverse Instructions
por: Köksal, Abdullatif, et al.
Publicado: (2023)

Generative Representational Instruction Tuning
por: Muennighoff, Niklas, et al.
Publicado: (2024)

Instruction Tuning with Human Curriculum
por: Lee, Bruce W., et al.
Publicado: (2023)

Parameter-Efficient Fine-Tuning of LLMs with Mixture of Space Experts
por: Zhang, Buze, et al.
Publicado: (2026)

Parameter-Efficient Fine-Tuning for Low-Resource Languages: A Comparative Study of LLMs for Bengali Hate Speech Detection
por: Islam, Akif, et al.
Publicado: (2025)

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
por: Nikdan, Mahdi, et al.
Publicado: (2024)

NeuroAda: Activating Each Neuron's Potential for Parameter-Efficient Fine-Tuning
por: Zhang, Zhi, et al.
Publicado: (2025)

Efficient Agent Training for Computer Use
por: He, Yanheng, et al.
Publicado: (2025)

On the Effect of Instruction Tuning Loss on Generalization
por: Chatterjee, Anwoy, et al.
Publicado: (2025)

Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs
por: Wang, Ruoyu, et al.
Publicado: (2024)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
por: Zhang, Zheng, et al.
Publicado: (2024)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
por: Wang, Tuowei, et al.
Publicado: (2025)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
por: Liu, Yilun, et al.
Publicado: (2025)

Instruction Mining: Instruction Data Selection for Tuning Large Language Models
por: Cao, Yihan, et al.
Publicado: (2023)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
por: Yang, Runming, et al.
Publicado: (2024)

X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios
por: Kwak, Namju, et al.
Publicado: (2024)

The Best Instruction-Tuning Data are Those That Fit
por: Zhang, Dylan, et al.
Publicado: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
por: Liu, Zeyu, et al.
Publicado: (2024)

BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Models
por: Chang, Aofei, et al.
Publicado: (2024)

Multilingual Instruction Tuning With Just a Pinch of Multilinguality
por: Shaham, Uri, et al.
Publicado: (2024)

SMART: Submodular Data Mixture Strategy for Instruction Tuning
por: Renduchintala, H S V N S Kowndinya, et al.
Publicado: (2024)

LESS: Selecting Influential Data for Targeted Instruction Tuning
por: Xia, Mengzhou, et al.
Publicado: (2024)