Image de couverture de livre

Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Song, Haobo, Zhao, Hao, Majumder, Soumajit, Lin, Tao
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

AMAQ: Adaptive Mixed-bit Activation Quantization for Collaborative Parameter Efficient Fine-tuning
par: Song, Yurun, et autres
Publié: (2025)

Parameter Efficient Fine-tuning via Explained Variance Adaptation
par: Paischer, Fabian, et autres
Publié: (2024)

Efficient Model Development through Fine-tuning Transfer
par: Lin, Pin-Jie, et autres
Publié: (2025)

Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
par: Xu, Jing, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
par: Zhang, Dan, et autres
Publié: (2025)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
par: Song, Weixi, et autres
Publié: (2023)

Explain Less, Understand More: Jargon Detection via Personalized Parameter-Efficient Fine-tuning
par: Wu, Bohao, et autres
Publié: (2025)

LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
par: Chen, Yukang, et autres
Publié: (2023)

Efficient End-to-end Language Model Fine-tuning on Graphs
par: Xue, Rui, et autres
Publié: (2023)

Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification
par: Li, Ming, et autres
Publié: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
par: Ma, Xinyu, et autres
Publié: (2024)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
par: Shi, Zhengxiang, et autres
Publié: (2023)

Q-PEFT: Query-dependent Parameter Efficient Fine-tuning for Text Reranking with Large Language Models
par: Peng, Zhiyuan, et autres
Publié: (2024)

Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models
par: Zhao, Siyan, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
par: Wang, Luping, et autres
Publié: (2024)

Obliviate: Neutralizing Task-agnostic Backdoors within the Parameter-efficient Fine-tuning Paradigm
par: Kim, Jaehan, et autres
Publié: (2024)

Exploring Memorization in Fine-tuned Language Models
par: Zeng, Shenglai, et autres
Publié: (2023)

Entity-level Factual Adaptiveness of Fine-tuning based Abstractive Summarization Models
par: Song, Jongyoon, et autres
Publié: (2024)

LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning
par: Huang, Wei, et autres
Publié: (2026)

A Framework to Implement 1+N Multi-task Fine-tuning Pattern in LLMs Using the CGC-LORA Algorithm
par: Song, Chao, et autres
Publié: (2024)

Information Guided Regularization for Fine-tuning Language Models
par: Sharma, Mandar, et autres
Publié: (2024)

Fine-tuning Language Models with Generative Adversarial Reward Modelling
par: Yu, Zhang Ze, et autres
Publié: (2023)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
par: Oliver, Michael, et autres
Publié: (2024)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
par: Zhang, Zheng, et autres
Publié: (2024)

FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition
par: Yan, Yuxuan, et autres
Publié: (2024)

Selecting Large Language Model to Fine-tune via Rectified Scaling Law
par: Lin, Haowei, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
par: Gao, Ziqi, et autres
Publié: (2024)

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
par: Lingam, Vijay, et autres
Publié: (2024)

LLM4DistReconfig: A Fine-tuned Large Language Model for Power Distribution Network Reconfiguration
par: Christou, Panayiotis, et autres
Publié: (2025)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
par: Wang, Tuowei, et autres
Publié: (2025)

The Importance of Online Data: Understanding Preference Fine-tuning via Coverage
par: Song, Yuda, et autres
Publié: (2024)

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning
par: Zou, Jiaru, et autres
Publié: (2024)

Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications
par: Balne, Charith Chandra Sai, et autres
Publié: (2024)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
par: Pathak, Harsh Nilesh, et autres
Publié: (2025)

Mechanistic Fine-tuning for In-context Learning
par: Cho, Hakaze, et autres
Publié: (2025)

ScaLearn: Simple and Highly Parameter-Efficient Task Transfer by Learning to Scale
par: Frohmann, Markus, et autres
Publié: (2023)

PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts
par: Zhang, Ming, et autres
Publié: (2025)

APE: Selective Fine-tuning with Acceptance Criteria for Language Model Adaptation
par: Marín, Javier
Publié: (2025)

DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned Models
par: Deng, Wenlong, et autres
Publié: (2024)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
par: Ban, Hao, et autres
Publié: (2025)