Image de couverture de livre

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Abbasi, Reza, Lim, Sernam
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

GPU Memory Usage Optimization for Backward Propagation in Deep Network Training
par: Hong, Ding-Yong, et autres
Publié: (2025)

LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs
par: Kim, Taeho, et autres
Publié: (2024)

Tri-Accel: Curvature-Aware Precision-Adaptive and Memory-Elastic Optimization for Efficient GPU Usage
par: Sheibanian, Mohsen, et autres
Publié: (2025)

On the Universality of Transformer Architectures; How Much Attention Is Enough?
par: Abbasi, Amirreza, et autres
Publié: (2025)

ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory
par: Wang, Liangyu, et autres
Publié: (2025)

Opportunities in deep learning methods development for computational biology
par: Lee, Alex Jihun, et autres
Publié: (2024)

Expanding Sparse Tuning for Low Memory Usage
par: Shen, Shufan, et autres
Publié: (2024)

Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended
par: Kamath, Aditya K, et autres
Publié: (2026)

Mastering Memory Tasks with World Models
par: Samsami, Mohammad Reza, et autres
Publié: (2024)

GPU Memory Prediction for Multimodal Model Training
par: Jeong, Jinwoo, et autres
Publié: (2025)

MeMoir: A Software-Driven Covert Channel based on Memory Usage
par: Gonzalez-Gomez, Jeferson, et autres
Publié: (2024)

Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
par: Recasens, Pol G., et autres
Publié: (2025)

FloE: On-the-Fly MoE Inference on Memory-constrained GPU
par: Zhou, Yuxin, et autres
Publié: (2025)

Loki: Representation over Architecture for Diffusion-Based Portrait Animation
par: Navard, Pouyan, et autres
Publié: (2026)

Universality in Transfer Learning for Linear Models
par: Ghane, Reza, et autres
Publié: (2024)

Scaling On-Device GPU Inference for Large Generative Models
par: Tang, Jiuqiang, et autres
Publié: (2025)

Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)
par: Abbasi, Jassem, et autres
Publié: (2022)

Gaussian Universality for Diffusion Models
par: Ghane, Reza, et autres
Publié: (2025)

GPU-Fuzz: Finding Memory Errors in Deep Learning Frameworks
par: Li, Zihao, et autres
Publié: (2026)

Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness
par: Duan, Hanyu, et autres
Publié: (2025)

Machine Learning Applications to Computational Plasma Physics and Reduced-Order Plasma Modeling: A Perspective
par: Faraji, Farbod, et autres
Publié: (2024)

xMem: A CPU-Based Approach for Accurate Estimation of GPU Memory in Deep Learning Training Workloads
par: Shi, Jiabo, et autres
Publié: (2025)

Inverted Activations: Reducing Memory Footprint in Neural Network Training
par: Novikov, Georgii, et autres
Publié: (2024)

Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
par: Yang, Yuchen, et autres
Publié: (2024)

GPU-Accelerated INT8 Quantization for KV Cache Compression in Large Language Models
par: Taneja, Maanas, et autres
Publié: (2026)

Reinforcement Learning for Dynamic Memory Allocation
par: Lim, Arisrei, et autres
Publié: (2024)

Mobility-Assisted Decentralized Federated Learning: Convergence Analysis and A Data-Driven Approach
par: Jahani, Reza, et autres
Publié: (2025)

Learning Latent Space Dynamics with Model-Form Uncertainties: A Stochastic Reduced-Order Modeling Approach
par: Yong, Jin Yi, et autres
Publié: (2024)

LLMPerf: GPU Performance Modeling meets Large Language Models
par: Nguyen, Khoi N. M., et autres
Publié: (2025)

Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization
par: Wang, Chong, et autres
Publié: (2026)

Memory-Reduced Meta-Learning with Guaranteed Convergence
par: Yang, Honglin, et autres
Publié: (2024)

Multi-Stage Prototype Learning for Interpretable Time Series Classification
par: Kalisetti, Bhavesh, et autres
Publié: (2021)

Semantic-Aware Scheduling for GPU Clusters with Large Language Models
par: Wang, Zerui, et autres
Publié: (2025)

Online Learning Models for Vehicle Usage Prediction During COVID-19
par: Lindroth, Tobias, et autres
Publié: (2022)

FRUGAL: Memory-Efficient Optimization by Reducing State Overhead for Scalable Training
par: Zmushko, Philip, et autres
Publié: (2024)

Reducing Smoothness with Expressive Memory Enhanced Hierarchical Graph Neural Networks
par: Bailie, Thomas, et autres
Publié: (2025)

The Mosaic Memory of Large Language Models
par: Shilov, Igor, et autres
Publié: (2024)

SoftDTW-CUDA-Torch: Memory-Efficient GPU-Accelerated Soft Dynamic Time Warping for PyTorch
par: Weber, Ron Shapira, et autres
Publié: (2026)

LLM Enhancer: Merged Approach using Vector Embedding for Reducing Large Language Model Hallucinations with External Knowledge
par: Rayhan, Naheed, et autres
Publié: (2025)

PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
par: Song, Yixin, et autres
Publié: (2023)