Imagen de Portada

BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Luo, Qijun, Yu, Hengxu, Li, Xiao
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs
por: Luo, Qijun, et al.
Publicado: (2025)

A Memory Efficient Randomized Subspace Optimization Method for Training Large Language Models
por: Chen, Yiming, et al.
Publicado: (2025)

Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
por: Shu, Yao, et al.
Publicado: (2024)

High Probability Guarantees for Random Reshuffling
por: Yu, Hengxu, et al.
Publicado: (2023)

A Bayesian Hybrid Parameter-Efficient Fine-Tuning Method for Large Language Models
por: Chai, Yidong, et al.
Publicado: (2025)

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models
por: Li, Ziniu, et al.
Publicado: (2023)

Large Language Model Agent for Hyper-Parameter Optimization
por: Liu, Siyi, et al.
Publicado: (2024)

ARO: A New Lens On Matrix Optimization For Large Models
por: Gong, Wenbo, et al.
Publicado: (2026)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
por: Wang, Fei, et al.
Publicado: (2024)

Alada: Alternating Adaptation of Momentum Method for Memory-Efficient Matrix Optimization
por: He, Xiaoyu, et al.
Publicado: (2025)

ChunkFT: Byte-Streamed Optimization for Memory-Efficient Full Fine-Tuning
por: Liu, Yongkang, et al.
Publicado: (2026)

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
por: Xu, Peng, et al.
Publicado: (2024)

Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models
por: Chen, Yuyan, et al.
Publicado: (2024)

Augmenting Parameter-Efficient Pre-trained Language Models with Large Language Models
por: Anand, Saurabh, et al.
Publicado: (2026)

RevFFN: Memory-Efficient Full-Parameter Fine-Tuning of Mixture-of-Experts LLMs with Reversible Blocks
por: Liu, Ningyuan, et al.
Publicado: (2025)

Evaluating Parameter Efficient Methods for RLVR
por: Yin, Qingyu, et al.
Publicado: (2025)

Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent
por: Wang, Lin, et al.
Publicado: (2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
por: Lu, Xudong, et al.
Publicado: (2024)

Optimizing In-Context Learning for Efficient Full Conformal Prediction
por: Deng, Weicao, et al.
Publicado: (2025)

Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models
por: Jo, Dongwon, et al.
Publicado: (2024)

Parameter-Efficient Tuning Large Language Models for Graph Representation Learning
por: Zhu, Qi, et al.
Publicado: (2024)

Adapting Large Language Models for Parameter-Efficient Log Anomaly Detection
por: Lim, Ying Fu, et al.
Publicado: (2025)

Spectra as Language: Large Language Models for Scalable Stellar Parameter and Abundance Inference
por: Lu, Hai-Ling, et al.
Publicado: (2026)

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization
por: Che, Tianshi, et al.
Publicado: (2023)

Optimizing Specific and Shared Parameters for Efficient Parameter Tuning
por: Nguyen, Van-Anh, et al.
Publicado: (2025)

Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge
por: Yan, Hengxu, et al.
Publicado: (2024)

Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning
por: Liu, Yongkang, et al.
Publicado: (2025)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
por: Fang, Zihan, et al.
Publicado: (2024)

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
por: Zhao, Yequan, et al.
Publicado: (2026)

Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
por: Han, Zeyu, et al.
Publicado: (2024)

Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization
por: Shen, Qianli, et al.
Publicado: (2024)

Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression
por: Wang, Jingcun, et al.
Publicado: (2024)

Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models
por: Yao, Kai, et al.
Publicado: (2024)

Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities
por: Hao, Zhiwei, et al.
Publicado: (2025)

Shuttle Between the Instructions and the Parameters of Large Language Models
por: Sun, Wangtao, et al.
Publicado: (2025)

Layer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language Models
por: Pham, Cuong, et al.
Publicado: (2025)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
por: Yang, Runming, et al.
Publicado: (2024)

Parameter Efficient Multi-task Model Fusion with Partial Linearization
por: Tang, Anke, et al.
Publicado: (2023)

CEM: A Data-Efficient Method for Large Language Models to Continue Evolving From Mistakes
por: Zhao, Haokun, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning of Large Language Models for Unit Test Generation: An Empirical Study
por: Storhaug, André, et al.
Publicado: (2024)