Cover Image

Lossless and Near-Lossless Compression for Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hershcovitch, Moshik, Choshen, Leshem, Wood, Andrew, Enmouri, Ilias, Chin, Peter, Sundararaman, Swaminathan, Harnik, Danny
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ZipNN: Lossless Compression for AI Models
by: Hershcovitch, Moshik, et al.
Published: (2024)

eOptShrinkQ: Near-Lossless KV Cache Compression Through Optimal Spectral Denoising and Quantization
by: Su, Pei-Chun
Published: (2026)

Lossless Compression via Chained Lightweight Neural Predictors with Information Inheritance
by: Kim, Yuriy, et al.
Published: (2026)

Quad Length Codes for Lossless Compression of e4m3
by: Agrawal, Aditya, et al.
Published: (2026)

AlphaZip: Neural Network-Enhanced Lossless Text Compression
by: Narashiman, Swathi Shree, et al.
Published: (2024)

StateSMix: Online Lossless Compression via Mamba State Space Models and Sparse N-gram Context Mixing
by: Tacconelli, Roberto
Published: (2026)

Lossless Image Compression Using Multi-level Dictionaries: Binary Images
by: Agnihotri, Samar, et al.
Published: (2024)

OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data
by: Zhao, Yan, et al.
Published: (2026)

Lossless Analog Compression
by: Alberti, Giovanni, et al.
Published: (2018)

Synchronizing Probabilities in Model-Driven Lossless Compression
by: Adler, Aviv, et al.
Published: (2026)

The Sample Complexity of Lossless Data Compression
by: Viaud, Terence, et al.
Published: (2026)

Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search
by: Severo, Daniel, et al.
Published: (2025)

Learning Structurally Stabilized Representations for Multi-modal Lossless DNA Storage
by: Cao, Ben, et al.
Published: (2024)

Analysis and Enhancement of Lossless Image Compression in JPEG-XL
by: Mamedov, Rustam
Published: (2024)

Asymmetric Encoding-Decoding Schemes for Lossless Data Compression
by: Yamamoto, Hirosuke, et al.
Published: (2026)

A Lossless Compression Technique for the Downlink Control Information Message
by: Liu, Bryan, et al.
Published: (2024)

Achieving the Fundamental Limit of Lossless Analog Compression via Polarization
by: Yuan, Shuai, et al.
Published: (2023)

Lossless Compression of Time Series Data: A Comparative Study
by: Matt, Jonas G., et al.
Published: (2025)

Proximity to Losslessly Compressible Parameters
by: Farrugia-Roberts, Matthew
Published: (2023)

Aperiodic Structures Never Collapse: Fibonacci Hierarchies for Lossless Compression
by: Tacconelli, Roberto
Published: (2026)

Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation Accuracy
by: Zhao, Yao, et al.
Published: (2023)

EDPC: Accelerating Lossless Compression via Lightweight Probability Models and Decoupled Parallel Dataflow
by: Lu, Zeyi, et al.
Published: (2025)

A Model-Driven Lossless Compression Algorithm Resistant to Mismatch
by: Hu, Cordelia, et al.
Published: (2026)

Challenges and Solutions in Selecting Optimal Lossless Data Compression Algorithms
by: Rahman, Md. Atiqur, et al.
Published: (2025)

Lossless Compression for LLM Tensor Incremental Snapshots
by: Waddington, Daniel, et al.
Published: (2025)

Incompressibility and Lossless Data Compression: An Approach by Pattern Discovery
by: Oscar Herrera Alcántara
Published: (2009)

Nacrith: Neural Lossless Compression via Ensemble Context Modeling and High-Precision CDF Coding
by: Tacconelli, Roberto
Published: (2026)

Empirical Lossless Compression Bound of a Data Sequence
by: Li, Lei M
Published: (2023)

Lossless data compression by large models
by: Li, Ziguang, et al.
Published: (2024)

LoMA: Lossless Compressed Memory Attention
by: Wang, Yumeng, et al.
Published: (2024)

TurboAngle: Near-Lossless KV Cache Compression via Uniform Angle Quantization
by: Patel, Dipkumar
Published: (2026)

Test-Time Steering for Lossless Text Compression via Weighted Product of Experts
by: Zhang, Qihang, et al.
Published: (2025)

Near-Lossless Model Compression Enables Longer Context Inference in DNA Large Language Models
by: Zhu, Rui, et al.
Published: (2025)

GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM
by: Kang, Hao, et al.
Published: (2024)

How Big Should a Wireless Foundation Model Be?
by: Cheng, Wei-Lun, et al.
Published: (2026)

A Graph Foundation Model for Wireless Resource Allocation
by: Sheng, Yucheng, et al.
Published: (2026)

Lossless Compression: A New Benchmark for Time Series Model Evaluation
by: Wan, Meng, et al.
Published: (2025)

Just Wing It: Near-Optimal Estimation of Missing Mass in a Markovian Sequence
by: Pananjady, Ashwin, et al.
Published: (2024)

Learning to Compress: Local Rank and Information Compression in Deep Neural Networks
by: Patel, Niket, et al.
Published: (2024)

To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
by: Yang, Zeyu, et al.
Published: (2025)