Image de couverture de livre

Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Park, Juneyoung, Hong, Yuri, Kim, Seongwan, Lee, Jaeho
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

Riemannian Optimization for LoRA on the Stiefel Manifold
par: Park, Juneyoung, et autres
Publié: (2025)

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
par: Zhang, Yihua, et autres
Publié: (2024)

Memory-Efficient Fine-Tuning of Transformers via Token Selection
par: Simoulin, Antoine, et autres
Publié: (2025)

Rethinking the Rank Threshold for LoRA Fine-Tuning
par: Park, Juneyoung
Publié: (2026)

QEFT: Quantization for Efficient Fine-Tuning of LLMs
par: Lee, Changhun, et autres
Publié: (2024)

PocketLLM: Enabling On-Device Fine-Tuning for Personalized LLMs
par: Peng, Dan, et autres
Publié: (2024)

Prior-Informed Zeroth-Order Optimization with Adaptive Direction Alignment for Memory-Efficient LLM Fine-Tuning
par: Jin, Feihu, et autres
Publié: (2026)

On-Device Fine-Tuning via Backprop-Free Zeroth-Order Optimization
par: Katti, Prabodh, et autres
Publié: (2025)

Memory-Efficient Backpropagation for Fine-Tuning LLMs on Resource-Constrained Mobile Devices
par: Song, Congzheng, et autres
Publié: (2025)

Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
par: Jie, Shibo, et autres
Publié: (2024)

Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization
par: Shin, Sungbin, et autres
Publié: (2024)

Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models
par: Son, Hyegang, et autres
Publié: (2024)

ChunkFT: Byte-Streamed Optimization for Memory-Efficient Full Fine-Tuning
par: Liu, Yongkang, et autres
Publié: (2026)

Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization
par: Son, Seungwoo, et autres
Publié: (2024)

Phasor Memory Networks: Stable Backpropagation Through Time for Scalable Explicit Memory
par: Goo, Sungwoo, et autres
Publié: (2026)

Parameter-Efficient Fine-Tuning of State Space Models
par: Galim, Kevin, et autres
Publié: (2024)

MSSR: Memory-Aware Adaptive Replay for Continual LLM Fine-Tuning
par: Lu, Yiyang, et autres
Publié: (2026)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
par: Wang, Fei, et autres
Publié: (2024)

Personalized Collaborative Fine-Tuning for On-Device Large Language Models
par: Wagner, Nicolas, et autres
Publié: (2024)

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models
par: Arteaga, Gabriel Y., et autres
Publié: (2024)

LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
par: Liu, Yezi, et autres
Publié: (2025)

DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation
par: Woo, Sunghyeon, et autres
Publié: (2024)

L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Models
par: Jeon, Hyesung, et autres
Publié: (2024)

TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models
par: Liu, Zefang, et autres
Publié: (2024)

LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs
par: Kim, Taeho, et autres
Publié: (2024)

Zhyper: Factorized Hypernetworks for Conditioned LLM Fine-Tuning
par: Abdalla, M. H. I., et autres
Publié: (2025)

Selection of LLM Fine-Tuning Data based on Orthogonal Rules
par: Li, Xiaomin, et autres
Publié: (2024)

Understanding the Performance and Estimating the Cost of LLM Fine-Tuning
par: Xia, Yuchen, et autres
Publié: (2024)

From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment
par: Chen, Hao, et autres
Publié: (2026)

Lost in the Prompt Order: Revealing the Limitations of Causal Attention in Language Models
par: Ok, Hyunjong, et autres
Publié: (2026)

AssertBench: A Benchmark for Evaluating Self-Assertion in Large Language Models
par: Lee, Jaeho, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning via Circular Convolution
par: Chen, Aochuan, et autres
Publié: (2024)

Ladder Up, Memory Down: Low-Cost Fine-Tuning With Side Nets
par: Zheng, Estelle, et autres
Publié: (2025)

Evaluating Memory Structure in LLM Agents
par: Shutova, Alina, et autres
Publié: (2026)

ZIP: An Efficient Zeroth-order Prompt Tuning for Black-box Vision-Language Models
par: Park, Seonghwan, et autres
Publié: (2025)

TempCore: Are Video QA Benchmarks Temporally Grounded? A Frame Selection Sensitivity Analysis and Benchmark
par: Ok, Hyunjong, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain
par: Gema, Aryo Pradipta, et autres
Publié: (2023)

FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics
par: Du, Yupei, et autres
Publié: (2023)