Image de couverture de livre

HUT: A More Computation Efficient Fine-Tuning Method With Hadamard Updated Transformation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Geyuan, Zhou, Xiaofei, Chen, Chuheng
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
par: Gao, Ziqi, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning With Adapters
par: Chen, Keyu, et autres
Publié: (2024)

Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning
par: Liang, Yao, et autres
Publié: (2024)

Comparative Analysis of Efficient Adapter-Based Fine-Tuning of State-of-the-Art Transformer Models
par: Siddiqui, Saad Mashkoor, et autres
Publié: (2025)

Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ?
par: Hu, Xu, et autres
Publié: (2026)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
par: Pathak, Harsh Nilesh, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning for Medical Text Summarization: A Comparative Study of Lora, Prompt Tuning, and Full Fine-Tuning
par: Shernazarov, Ulugbek, et autres
Publié: (2026)

Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
par: Ponkshe, Kaustubh, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning of Large Language Models via Deconvolution in Subspace
par: Zhang, Jia-Chen, et autres
Publié: (2025)

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
par: Zheng, Yaowei, et autres
Publié: (2024)

STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models
par: Zhang, Linhai, et autres
Publié: (2024)

TsqLoRA: Towards Sensitivity and Quality Low-Rank Adaptation for Efficient Fine-Tuning
par: Chen, Yu, et autres
Publié: (2025)

Efficient Fine-Tuning of Large Language Models for Automated Medical Documentation
par: Leong, Hui Yi, et autres
Publié: (2024)

Impact of Fine-Tuning Methods on Memorization in Large Language Models
par: Hou, Jie, et autres
Publié: (2025)

RankAdaptor: Hierarchical Rank Allocation for Efficient Fine-Tuning Pruned LLMs via Performance Model
par: Zhou, Changhai, et autres
Publié: (2024)

MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models
par: Cao, Jie, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning for Foundation Models
par: Zhang, Dan, et autres
Publié: (2025)

Phased Instruction Fine-Tuning for Large Language Models
par: Pang, Wei, et autres
Publié: (2024)

PEFT-U: Parameter-Efficient Fine-Tuning for User Personalization
par: Clarke, Christopher, et autres
Publié: (2024)

Reversing Large Language Models for Efficient Training and Fine-Tuning
par: Gal, Eshed, et autres
Publié: (2025)

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
par: Li, Xianming, et autres
Publié: (2026)

Natural Language Fine-Tuning
par: Liu, Jia, et autres
Publié: (2024)

InfiMed-Foundation: Pioneering Advanced Multimodal Medical Models with Compute-Efficient Pre-Training and Multi-Stage Fine-Tuning
par: Zhu, Guanghao, et autres
Publié: (2025)

SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning
par: Fu, Yuqian, et autres
Publié: (2025)

Supervised Fine-Tuning versus Reinforcement Learning: A Study of Post-Training Methods for Large Language Models
par: Jiang, Haitao, et autres
Publié: (2026)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
par: Zhou, Han, et autres
Publié: (2023)

TokenSeek: Memory Efficient Fine Tuning via Instance-Aware Token Ditching
par: Zeng, Runjia, et autres
Publié: (2026)

A Scaling Law for Token Efficiency in LLM Fine-Tuning Under Fixed Compute Budgets
par: Lagasse, Ryan, et autres
Publié: (2025)

Geo-Expert: Towards Expert-Level Geological Reasoning via Parameter-Efficient Fine-Tuning
par: Guo, Chenyou, et autres
Publié: (2026)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
par: Wang, Luping, et autres
Publié: (2024)

Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting
par: Hong, Yijie, et autres
Publié: (2025)

Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models
par: Setty, Vinay
Publié: (2024)

Cause-Aware Empathetic Response Generation via Chain-of-Thought Fine-Tuning
par: Chen, Xinhao, et autres
Publié: (2024)

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
par: Tian, Chunlin, et autres
Publié: (2024)

LoR2C : Low-Rank Residual Connection Adaptation for Parameter-Efficient Fine-Tuning
par: Zhao, Jiancheng, et autres
Publié: (2025)

TS-PEFT: Unveiling Token-Level Redundancy in Parameter-Efficient Fine-Tuning
par: Ma, Dabiao, et autres
Publié: (2025)

MiCA Learns More Knowledge Than LoRA and Full Fine-Tuning
par: Rüdiger, Sten, et autres
Publié: (2026)

Why Reinforcement Fine-Tuning Enables MLLMs Preserve Prior Knowledge Better: A Data Perspective
par: Zhang, Zhihao, et autres
Publié: (2025)

Learning to Prioritize IT Tickets: A Comparative Evaluation of Embedding-based Approaches and Fine-Tuned Transformer Models
par: LÊ, Minh Tri, et autres
Publié: (2025)

Detecting AI-Generated Paraphrases in Bengali: A Comparative Study of Zero-Shot and Fine-Tuned Transformers
par: Islam, Md. Rakibul, et autres
Publié: (2025)