Cover Image

Lossless Compression via Chained Lightweight Neural Predictors with Information Inheritance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kim, Yuriy, Belyaev, Evgeny
Format:	Preprint
Published:	2026
Subjects:	Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Efficient Compression of Deep Neural Network Checkpoints Based on Prediction and Context Modeling
by: Kim, Yuriy, et al.
Published: (2025)

Lossless and Near-Lossless Compression for Foundation Models
by: Hershcovitch, Moshik, et al.
Published: (2024)

ZipNN: Lossless Compression for AI Models
by: Hershcovitch, Moshik, et al.
Published: (2024)

AlphaZip: Neural Network-Enhanced Lossless Text Compression
by: Narashiman, Swathi Shree, et al.
Published: (2024)

Quad Length Codes for Lossless Compression of e4m3
by: Agrawal, Aditya, et al.
Published: (2026)

OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data
by: Zhao, Yan, et al.
Published: (2026)

StateSMix: Online Lossless Compression via Mamba State Space Models and Sparse N-gram Context Mixing
by: Tacconelli, Roberto
Published: (2026)

Learning to Compress: Local Rank and Information Compression in Deep Neural Networks
by: Patel, Niket, et al.
Published: (2024)

eOptShrinkQ: Near-Lossless KV Cache Compression Through Optimal Spectral Denoising and Quantization
by: Su, Pei-Chun
Published: (2026)

Property Inheritance for Subtensors in Tensor Train Decompositions
by: Cai, HanQin, et al.
Published: (2025)

Lossless Image Compression Using Multi-level Dictionaries: Binary Images
by: Agnihotri, Samar, et al.
Published: (2024)

Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
by: Zhang, Shihao, et al.
Published: (2025)

Data-dependent Generalization Bounds via Variable-Size Compressibility
by: Sefidgaran, Milad, et al.
Published: (2023)

Cross-Domain Lossy Compression via Constrained Minimum Entropy Coupling
by: Nguyen, Nam, et al.
Published: (2026)

GeoIB: Geometry-Aware Information Bottleneck via Statistical-Manifold Compression
by: Wang, Weiqi, et al.
Published: (2026)

An Information-Theoretic Approach to Understanding Transformers' In-Context Learning of Variable-Order Markov Chains
by: Zhou, Ruida, et al.
Published: (2024)

EDPC: Accelerating Lossless Compression via Lightweight Probability Models and Decoupled Parallel Dataflow
by: Lu, Zeyi, et al.
Published: (2025)

Context Steering: A New Paradigm for Compression-based Embeddings by Synthesizing Relevant Information Features
by: Sarasa, Guillermo, et al.
Published: (2025)

Neural Window Decoder for SC-LDPC Codes
by: Yun, Dae-Young, et al.
Published: (2024)

A Neural Difference-of-Entropies Estimator for Mutual Information
by: Ni, Haoran, et al.
Published: (2025)

Information-Theoretic Generalization Bounds for Deep Neural Networks
by: He, Haiyun, et al.
Published: (2024)

Coding for Computation: Efficient Compression of Neural Networks for Reconfigurable Hardware
by: Rosenberger, Hans, et al.
Published: (2025)

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
by: Makkuva, Ashok Vardhan, et al.
Published: (2024)

Neural Distributed Source Coding
by: Whang, Jay, et al.
Published: (2021)

Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
by: Lei, Eric, et al.
Published: (2024)

Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations with MDL-SAEs
by: Ayonrinde, Kola, et al.
Published: (2024)

Code Rate Optimization via Neural Polar Decoders
by: Aharoni, Ziv, et al.
Published: (2025)

Information-Theoretic Limits of Quantum Learning via Data Compression
by: Angrisani, Armando, et al.
Published: (2021)

Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search
by: Severo, Daniel, et al.
Published: (2025)

Exploration-Exploitation Tradeoff in Universal Lossy Compression
by: Weinberger, Nir, et al.
Published: (2025)

Application of Deep Learning in Biological Data Compression
by: Zou, Chunyu
Published: (2025)

Covariance Matrix Construction with Preprocessing-Based Spatial Sampling for Robust Adaptive Beamforming
by: Mohammadzadeh, Saeed, et al.
Published: (2025)

FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression
by: Lee, Namyoon, et al.
Published: (2026)

Structure Learning via Mutual Information
by: Nixon, Jeremy
Published: (2024)

Agnostic Sample Compression Schemes for Regression
by: Attias, Idan, et al.
Published: (2018)

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
by: Kim, Munsik
Published: (2026)

Fundamental Limits of CSI Compression in FDD Massive MIMO
by: Park, Bumsu, et al.
Published: (2026)

Channel Simulation and Distributed Compression with Ensemble Rejection Sampling
by: Phan, Buu, et al.
Published: (2025)

Matrix Completion via Nonsmooth Regularization of Fully Connected Neural Networks
by: Faramarzi, Sajad, et al.
Published: (2024)

Generalization Bounds via Conditional $f$-Information
by: Wang, Ziqiao, et al.
Published: (2024)