Inshrinkerator: Compressing Deep Learning Training Checkpoints via Dynamic Quantization
Fuente:
arXiv
Saved in:
| Main Authors: | Agrawal, Amey, Reddy, Sameer, Bhattamishra, Satwik, Nookala, Venkata Prabhakara Sarath, Vashishth, Vidushi, Rong, Kexin, Tumanov, Alexey |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Hardness of Learning Regular Languages in the Next Symbol Prediction Setting
by: Bhattamishra, Satwik, et al.
Published: (2025)
by: Bhattamishra, Satwik, et al.
Published: (2025)
Maya: Optimizing Deep Learning Training Workloads using GPU Runtime Emulation
by: Yarlagadda, Srihas, et al.
Published: (2025)
by: Yarlagadda, Srihas, et al.
Published: (2025)
Provably Learning Attention with Queries
by: Bhattamishra, Satwik, et al.
Published: (2026)
by: Bhattamishra, Satwik, et al.
Published: (2026)
Separations in the Representational Capabilities of Transformers and Recurrent Architectures
by: Bhattamishra, Satwik, et al.
Published: (2024)
by: Bhattamishra, Satwik, et al.
Published: (2024)
Discovering Interpretable Algorithms by Decompiling Transformers to RASP
by: Huang, Xinting, et al.
Published: (2026)
by: Huang, Xinting, et al.
Published: (2026)
Benefits and Limitations of Communication in Multi-Agent Reasoning
by: Rizvi-Martel, Michael, et al.
Published: (2025)
by: Rizvi-Martel, Michael, et al.
Published: (2025)
On Evaluating Performance of LLM Inference Serving Systems
by: Agrawal, Amey, et al.
Published: (2025)
by: Agrawal, Amey, et al.
Published: (2025)
Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
by: Agrawal, Amey, et al.
Published: (2024)
by: Agrawal, Amey, et al.
Published: (2024)
Vidur: A Large-Scale Simulation Framework For LLM Inference
by: Agrawal, Amey, et al.
Published: (2024)
by: Agrawal, Amey, et al.
Published: (2024)
Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
by: Agrawal, Amey, et al.
Published: (2024)
by: Agrawal, Amey, et al.
Published: (2024)
DεpS: Delayed ε-Shrinking for Faster Once-For-All Training
by: Annavajjala, Aditya, et al.
Published: (2024)
by: Annavajjala, Aditya, et al.
Published: (2024)
No Request Left Behind: Tackling Heterogeneity in Long-Context LLM Inference with Medha
by: Agrawal, Amey, et al.
Published: (2024)
by: Agrawal, Amey, et al.
Published: (2024)
RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression
by: Behnam, Payman, et al.
Published: (2025)
by: Behnam, Payman, et al.
Published: (2025)
Beyond Following: Mixing Active Initiative into Computational Creativity
by: Lin, Zhiyu, et al.
Published: (2024)
by: Lin, Zhiyu, et al.
Published: (2024)
Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systems
by: Lin, Zhiyu, et al.
Published: (2023)
by: Lin, Zhiyu, et al.
Published: (2023)
BitSnap: Checkpoint Sparsification and Quantization in LLM Training
by: Peng, Yanxin, et al.
Published: (2025)
by: Peng, Yanxin, et al.
Published: (2025)
PLUM: Improving Inference Efficiency By Leveraging Repetition-Sparsity Trade-Off
by: Kuhar, Sachit, et al.
Published: (2023)
by: Kuhar, Sachit, et al.
Published: (2023)
VillainNet: Targeted Poisoning Attacks Against SuperNets Along the Accuracy-Latency Pareto Frontier - Artifact
by: David Oygenblik, et al.
Published: (2025)
by: David Oygenblik, et al.
Published: (2025)
Revati: Transparent GPU-Free Time-Warp Emulation for LLM Serving
by: Agrawal, Amey, et al.
Published: (2026)
by: Agrawal, Amey, et al.
Published: (2026)
Modelling the rotation dependence of cycle variability in sun-like stars: Answering why only slowly rotating stars produce grand minima
by: Vashishth, Vindya
Published: (2024)
by: Vashishth, Vindya
Published: (2024)
Hysteresis near the transition of the large-scale dynamo in the presence of the small-scale dynamo
by: Vashishth, Vindya
Published: (2024)
by: Vashishth, Vindya
Published: (2024)
Exploring the neuroprotective role of ubiquinone by attenuation of oxidative stress and mitochondrial dysfunction in an experimental model of myalgic encephalomyelitis/chronic fatigue stress
by: Anushka Vashishth
Published: (2024)
by: Anushka Vashishth
Published: (2024)
Exploring Quantization for Efficient Pre-Training of Transformer Language Models
by: Chitsaz, Kamran, et al.
Published: (2024)
by: Chitsaz, Kamran, et al.
Published: (2024)
A Formal Framework for Understanding Length Generalization in Transformers
by: Huang, Xinting, et al.
Published: (2024)
by: Huang, Xinting, et al.
Published: (2024)
STIQ: Safeguarding Training and Inferencing of Quantum Neural Networks from Untrusted Cloud
by: Kundu, Satwik, et al.
Published: (2024)
by: Kundu, Satwik, et al.
Published: (2024)
SuperFedNAS: Cost-Efficient Federated Neural Architecture Search for On-Device Inference
by: Khare, Alind, et al.
Published: (2023)
by: Khare, Alind, et al.
Published: (2023)
Unsteady Free Convection MHD Flow of an Incompressible Electrically Conducting Viscous Fluid through Porous Medium between Two Vertical Plates
by: G.Prabhakara Rao
Published: (2014)
by: G.Prabhakara Rao
Published: (2014)
Multichromophoric Macrocycle Nanoparticles for Mitigating Cyanine Limit and Efficient Aqueous Photocatalysis via Sequential Energy Transfer
by: Vidushi Gupta, et al.
Published: (2025)
by: Vidushi Gupta, et al.
Published: (2025)
DeCAL Tokenwise Compression
by: Panwar, Sameer
Published: (2025)
by: Panwar, Sameer
Published: (2025)
Conditions for sectoriality and compactness of the resolvent for a non-self-adjoint Sturm--Liouville operator with singular distributional potential
by: Tumanov, Sergey N.
Published: (2025)
by: Tumanov, Sergey N.
Published: (2025)
On Molchanov's criterion for compactness of the resolvent for a non self-adjoint Sturm-Liouville operator
by: Tumanov, Sergey N.
Published: (2024)
by: Tumanov, Sergey N.
Published: (2024)
An Efficient Compression of Deep Neural Network Checkpoints Based on Prediction and Context Modeling
by: Kim, Yuriy, et al.
Published: (2025)
by: Kim, Yuriy, et al.
Published: (2025)
Security Concerns in Quantum Machine Learning as a Service
by: Kundu, Satwik, et al.
Published: (2024)
by: Kundu, Satwik, et al.
Published: (2024)
Adversarial Data Poisoning Attacks on Quantum Machine Learning in the NISQ Era
by: Kundu, Satwik, et al.
Published: (2024)
by: Kundu, Satwik, et al.
Published: (2024)
Dry Spell Dynamics Impacting the Productivity of Rainfed Crops Over the Semi‐Arid Regions of South‐East India
by: Santanu Kumar Bal, et al.
Published: (2024)
by: Santanu Kumar Bal, et al.
Published: (2024)
The Transformer Cookbook
by: Yang, Andy, et al.
Published: (2025)
by: Yang, Andy, et al.
Published: (2025)
Effects of Epoxy Composition on the Thermal and Network Properties of Crosslinked Thermosets: A Molecular-Dynamics Study
by: Pola, Venkata Rama Manoj, et al.
Published: (2025)
by: Pola, Venkata Rama Manoj, et al.
Published: (2025)
Deep Probabilistic Unfolding for Quantized Compressive Sensing
by: Qu, Gang, et al.
Published: (2026)
by: Qu, Gang, et al.
Published: (2026)
Faithfulness Measurable Masked Language Models
by: Madsen, Andreas, et al.
Published: (2023)
by: Madsen, Andreas, et al.
Published: (2023)
Are self-explanations from Large Language Models faithful?
by: Madsen, Andreas, et al.
Published: (2024)
by: Madsen, Andreas, et al.
Published: (2024)
Similar Items
-
Hardness of Learning Regular Languages in the Next Symbol Prediction Setting
by: Bhattamishra, Satwik, et al.
Published: (2025) -
Maya: Optimizing Deep Learning Training Workloads using GPU Runtime Emulation
by: Yarlagadda, Srihas, et al.
Published: (2025) -
Provably Learning Attention with Queries
by: Bhattamishra, Satwik, et al.
Published: (2026) -
Separations in the Representational Capabilities of Transformers and Recurrent Architectures
by: Bhattamishra, Satwik, et al.
Published: (2024) -
Discovering Interpretable Algorithms by Decompiling Transformers to RASP
by: Huang, Xinting, et al.
Published: (2026)