Imagen de Portada

BlockLLM: Memory-Efficient Adaptation of LLMs by Selecting and Optimizing the Right Coordinate Blocks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ramesh, Amrutha Varshini, Ganapathiraman, Vignesh, Laradji, Issam H., Schmidt, Mark
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient In-Memory Acceleration of Sparse Block Diagonal LLMs
por: de Lima, João Paulo Cardoso, et al.
Publicado: (2025)

FOAM: Blocked State Folding for Memory-Efficient LLM Training
por: Wen, Ziqing, et al.
Publicado: (2025)

AdaBlock-dLLM: Semantic-Aware Diffusion LLM Inference via Adaptive Block Size
por: Lu, Guanxi, et al.
Publicado: (2025)

Exploiting Block Coordinate Descent for Cost-Effective LLM Model Training
por: Liu, Zeyu, et al.
Publicado: (2025)

FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering
por: Abaskohi, Amirhossein, et al.
Publicado: (2024)

RevFFN: Memory-Efficient Full-Parameter Fine-Tuning of Mixture-of-Experts LLMs with Reversible Blocks
por: Liu, Ningyuan, et al.
Publicado: (2025)

BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models
por: Hu, Bodun, et al.
Publicado: (2024)

LitLLMs, LLMs for Literature Review: Are we there yet?
por: Agarwal, Shubham, et al.
Publicado: (2024)

BlockDialect: Block-wise Fine-grained Mixed Format Quantization for Energy-Efficient LLM Inference
por: Jang, Wonsuk, et al.
Publicado: (2025)

Memory Efficient Neural Processes via Constant Memory Attention Block
por: Feng, Leo, et al.
Publicado: (2023)

Stochastic Approximation with Block Coordinate Optimal Stepsizes
por: Jiang, Tao, et al.
Publicado: (2025)

Fast Convergence of Softmax Policy Mirror Ascent
por: Asad, Reza, et al.
Publicado: (2024)

Hidden State Differential Private Mini-Batch Block Coordinate Descent for Multi-convexity Optimization
por: Chen, Ding, et al.
Publicado: (2024)

MABViT -- Modified Attention Block Enhances Vision Transformers
por: Ramesh, Mahesh, et al.
Publicado: (2023)

Breaking the Blocks: Continuous Low-Rank Decomposed Scaling for Unified LLM Quantization and Adaptation
por: Tang, Pingzhi, et al.
Publicado: (2026)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
por: Liu, Junkang, et al.
Publicado: (2026)

Differentially Private Random Block Coordinate Descent
por: Maranjyan, Artavazd, et al.
Publicado: (2024)

Optimizing Mixture of Block Attention
por: Xiao, Guangxuan, et al.
Publicado: (2025)

ParaBlock: Communication-Computation Parallel Block Coordinate Federated Learning for Large Language Models
por: Wang, Yujia, et al.
Publicado: (2025)

Block Coordinate Descent for Neural Networks Provably Finds Global Minima
por: Akiyama, Shunta
Publicado: (2025)

Deep Variable-Block Chain with Adaptive Variable Selection
por: Zhang, Lixiang, et al.
Publicado: (2019)

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs
por: Abillama, Pierre, et al.
Publicado: (2025)

Yantra AI -- An intelligence platform which interacts with manufacturing operations
por: Krishnamurthy, Varshini
Publicado: (2025)

A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints
por: Yuan, Ganzhao
Publicado: (2023)

Shaping Zero-Shot Coordination via State Blocking
por: Kang, Mingu, et al.
Publicado: (2026)

Blocking Bandits
por: Basu, Soumya, et al.
Publicado: (2019)

Block-Attention for Efficient Prefilling
por: Ma, Dongyang, et al.
Publicado: (2024)

AgentAda: Skill-Adaptive Data Analytics for Tailored Insight Discovery
por: Abaskohi, Amirhossein, et al.
Publicado: (2025)

BoRA: Towards More Expressive Low-Rank Adaptation with Block Diversity
por: Li, Shiwei, et al.
Publicado: (2025)

Randomized Block-Coordinate Optimistic Gradient Algorithms for Root-Finding Problems
por: Tran-Dinh, Quoc, et al.
Publicado: (2023)

Stochastic Primal-Dual Double Block-Coordinate for Two-way Partial AUC Maximization
por: Zhou, Linli, et al.
Publicado: (2025)

From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation
por: Yang, Qianwei, et al.
Publicado: (2026)

Efficient Sparse PCA via Block-Diagonalization
por: Del Pia, Alberto, et al.
Publicado: (2024)

Simplifying Transformer Blocks
por: He, Bobby, et al.
Publicado: (2023)

Bridging Maximum Likelihood and Optimal Transport for Efficient Inference and Model Selection in Stochastic Block Models
por: Queric, Simon, et al.
Publicado: (2026)

Alada: Alternating Adaptation of Momentum Method for Memory-Efficient Matrix Optimization
por: He, Xiaoyu, et al.
Publicado: (2025)

Small LLMs with Expert Blocks Are Good Enough for Hyperparamter Tuning
por: Naphade, Om, et al.
Publicado: (2025)

Improving Block-Wise LLM Quantization by 4-bit Block-Wise Optimal Float (BOF4): Analysis and Variations
por: Blumenberg, Patrick, et al.
Publicado: (2025)

Accelerating Multi-Block Constrained Optimization Through Learning to Optimize
por: Liang, Ling, et al.
Publicado: (2024)

PRISM: Breaking the O(n) Memory Wall in Long-Context LLM Inference via O(1) Photonic Block Selection
por: Park, Hyoseok, et al.
Publicado: (2026)