Cover Image

Natural GaLore: Accelerating GaLore for memory-efficient LLM Training and Fine-tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Das, Arijit
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Multiagent Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients
by: Zhang, Zhenyu, et al.
Published: (2024)

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
by: Zhao, Jiawei, et al.
Published: (2024)

GaLore 2: Large-Scale LLM Pre-Training by Gradient Low-Rank Projection
by: Su, DiJia, et al.
Published: (2025)

GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
by: Liao, Xutao, et al.
Published: (2024)

Subsampled Randomized Fourier GaLore for Adapting Foundation Models in Depth-Driven Liver Landmark Segmentation
by: Lin, Yun-Chen, et al.
Published: (2025)

TeamTR: Trust-Region Fine-Tuning for Multi-Agent LLM Coordination
by: Xie, Yi, et al.
Published: (2026)

Human Implicit Preference-Based Policy Fine-tuning for Multi-Agent Reinforcement Learning in USV Swarm
by: Kim, Hyeonjun, et al.
Published: (2025)

Automatic Construction of Clinical Scoring Systems with LLM Agents
by: Estévez, Silas Ruhrberg, et al.
Published: (2026)

Multi-agent Cooperative Games Using Belief Map Assisted Training
by: Huang, Qinwei, et al.
Published: (2024)

Get Experience from Practice: LLM Agents with Record & Replay
by: Feng, Erhu, et al.
Published: (2025)

DeepFusion: Accelerating MoE Training via Federated Knowledge Distillation from Heterogeneous Edge Devices
by: Li, Songyuan, et al.
Published: (2026)

Hybrid Training for Enhanced Multi-task Generalization in Multi-agent Reinforcement Learning
by: Zhang, Mingliang, et al.
Published: (2024)

An Introduction to Centralized Training for Decentralized Execution in Cooperative Multi-Agent Reinforcement Learning
by: Amato, Christopher
Published: (2024)

Sharing is Caring: Efficient LM Post-Training with Collective RL Experience Sharing
by: Amico, Jeffrey, et al.
Published: (2025)

The Practicality of Normalizing Flow Test-Time Training in Bayesian Inference for Agent-Based Models
by: Zhang, Junyao, et al.
Published: (2026)

Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems
by: Zhang, Guibin, et al.
Published: (2024)

Multi-Agent Training-free Urban Food Delivery System using Resilient UMST Network
by: Hasan, Md Nahid, et al.
Published: (2026)

LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacra
by: Karten, Seth, et al.
Published: (2025)

Prompting Robot Teams with Natural Language
by: Pfitzer, Nicolas, et al.
Published: (2025)

Memory-R2: Fair Credit Assignment for Long-Horizon Memory-Augmented LLM Agents
by: Yan, Sikuan, et al.
Published: (2026)

Structuring Collective Action with LLM-Guided Evolution: From Ill-Structured Problems to Executable Heuristics
by: Dsouza, Kevin Bradley, et al.
Published: (2025)

cMALC-D: Contextual Multi-Agent LLM-Guided Curriculum Learning with Diversity-Based Context Blending
by: Satheesh, Anirudh, et al.
Published: (2025)

LEED: A Highly Efficient and Scalable LLM-Empowered Expert Demonstrations Framework for Multi-Agent Reinforcement Learning
by: Duan, Tianyang, et al.
Published: (2025)

JaxRobotarium: Training and Deploying Multi-Robot Policies in 10 Minutes
by: Jain, Shalin Anand, et al.
Published: (2025)

Improving Generalization in Reinforcement Learning Training Regimes for Social Robot Navigation
by: Sigal, Adam, et al.
Published: (2023)

MinionsLLM: a Task-adaptive Framework For The Training and Control of Multi-Agent Systems Through Natural Language
by: Rincon, Andres Garcia, et al.
Published: (2025)

Differential error feedback for communication-efficient decentralized learning
by: Nassif, Roula, et al.
Published: (2024)

Debate2Create: Robot Co-design via Multi-Agent LLM Debate
by: Qiu, Kevin, et al.
Published: (2025)

Advancing Learnable Multi-Agent Pathfinding Solvers with Active Fine-Tuning
by: Andreychuk, Anton, et al.
Published: (2025)

Safe Multi-agent Reinforcement Learning with Natural Language Constraints
by: Wang, Ziyan, et al.
Published: (2024)

Massively Multiagent Minigames for Training Generalist Agents
by: Choe, Kyoung Whan, et al.
Published: (2024)

Accelerating Manufacturing Scale-Up from Material Discovery Using Agentic Web Navigation and Retrieval-Augmented AI for Process Engineering Schematics Design
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Exploiting inter-agent coupling information for efficient reinforcement learning of cooperative LQR
by: Syed, Shahbaz P Qadri, et al.
Published: (2025)

Linear Convergence of Independent Natural Policy Gradient in Games with Entropy Regularization
by: Sun, Youbang, et al.
Published: (2024)

RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Execution
by: Srivastava, Arunabh, et al.
Published: (2026)

Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?
by: Zhou, Yihe, et al.
Published: (2023)

Training Generalizable Collaborative Agents via Strategic Risk Aversion
by: Qu, Chengrui, et al.
Published: (2026)

On the Reliability Limits of LLM-Based Multi-Agent Planning
by: Ao, Ruicheng, et al.
Published: (2026)

ReDAct: Uncertainty-Aware Deferral for LLM Agents
by: Piatrashyn, Dzianis, et al.
Published: (2026)

PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning
by: Chen, Yiqun, et al.
Published: (2022)