Copertina

Lossless Compression via Chained Lightweight Neural Predictors with Information Inheritance

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kim, Yuriy, Belyaev, Evgeny
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Information Theory Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

An Efficient Compression of Deep Neural Network Checkpoints Based on Prediction and Context Modeling
di: Kim, Yuriy, et al.
Pubblicazione: (2025)

Lossless and Near-Lossless Compression for Foundation Models
di: Hershcovitch, Moshik, et al.
Pubblicazione: (2024)

ZipNN: Lossless Compression for AI Models
di: Hershcovitch, Moshik, et al.
Pubblicazione: (2024)

AlphaZip: Neural Network-Enhanced Lossless Text Compression
di: Narashiman, Swathi Shree, et al.
Pubblicazione: (2024)

Quad Length Codes for Lossless Compression of e4m3
di: Agrawal, Aditya, et al.
Pubblicazione: (2026)

OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data
di: Zhao, Yan, et al.
Pubblicazione: (2026)

StateSMix: Online Lossless Compression via Mamba State Space Models and Sparse N-gram Context Mixing
di: Tacconelli, Roberto
Pubblicazione: (2026)

Learning to Compress: Local Rank and Information Compression in Deep Neural Networks
di: Patel, Niket, et al.
Pubblicazione: (2024)

eOptShrinkQ: Near-Lossless KV Cache Compression Through Optimal Spectral Denoising and Quantization
di: Su, Pei-Chun
Pubblicazione: (2026)

Property Inheritance for Subtensors in Tensor Train Decompositions
di: Cai, HanQin, et al.
Pubblicazione: (2025)

Lossless Image Compression Using Multi-level Dictionaries: Binary Images
di: Agnihotri, Samar, et al.
Pubblicazione: (2024)

Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
di: Zhang, Shihao, et al.
Pubblicazione: (2025)

Data-dependent Generalization Bounds via Variable-Size Compressibility
di: Sefidgaran, Milad, et al.
Pubblicazione: (2023)

Cross-Domain Lossy Compression via Constrained Minimum Entropy Coupling
di: Nguyen, Nam, et al.
Pubblicazione: (2026)

GeoIB: Geometry-Aware Information Bottleneck via Statistical-Manifold Compression
di: Wang, Weiqi, et al.
Pubblicazione: (2026)

An Information-Theoretic Approach to Understanding Transformers' In-Context Learning of Variable-Order Markov Chains
di: Zhou, Ruida, et al.
Pubblicazione: (2024)

EDPC: Accelerating Lossless Compression via Lightweight Probability Models and Decoupled Parallel Dataflow
di: Lu, Zeyi, et al.
Pubblicazione: (2025)

Context Steering: A New Paradigm for Compression-based Embeddings by Synthesizing Relevant Information Features
di: Sarasa, Guillermo, et al.
Pubblicazione: (2025)

Neural Window Decoder for SC-LDPC Codes
di: Yun, Dae-Young, et al.
Pubblicazione: (2024)

A Neural Difference-of-Entropies Estimator for Mutual Information
di: Ni, Haoran, et al.
Pubblicazione: (2025)

Information-Theoretic Generalization Bounds for Deep Neural Networks
di: He, Haiyun, et al.
Pubblicazione: (2024)

Coding for Computation: Efficient Compression of Neural Networks for Reconfigurable Hardware
di: Rosenberger, Hans, et al.
Pubblicazione: (2025)

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
di: Makkuva, Ashok Vardhan, et al.
Pubblicazione: (2024)

Neural Distributed Source Coding
di: Whang, Jay, et al.
Pubblicazione: (2021)

Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
di: Lei, Eric, et al.
Pubblicazione: (2024)

Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations with MDL-SAEs
di: Ayonrinde, Kola, et al.
Pubblicazione: (2024)

Code Rate Optimization via Neural Polar Decoders
di: Aharoni, Ziv, et al.
Pubblicazione: (2025)

Information-Theoretic Limits of Quantum Learning via Data Compression
di: Angrisani, Armando, et al.
Pubblicazione: (2021)

Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search
di: Severo, Daniel, et al.
Pubblicazione: (2025)

Exploration-Exploitation Tradeoff in Universal Lossy Compression
di: Weinberger, Nir, et al.
Pubblicazione: (2025)

Application of Deep Learning in Biological Data Compression
di: Zou, Chunyu
Pubblicazione: (2025)

Covariance Matrix Construction with Preprocessing-Based Spatial Sampling for Robust Adaptive Beamforming
di: Mohammadzadeh, Saeed, et al.
Pubblicazione: (2025)

FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression
di: Lee, Namyoon, et al.
Pubblicazione: (2026)

Structure Learning via Mutual Information
di: Nixon, Jeremy
Pubblicazione: (2024)

Agnostic Sample Compression Schemes for Regression
di: Attias, Idan, et al.
Pubblicazione: (2018)

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
di: Kim, Munsik
Pubblicazione: (2026)

Fundamental Limits of CSI Compression in FDD Massive MIMO
di: Park, Bumsu, et al.
Pubblicazione: (2026)

Channel Simulation and Distributed Compression with Ensemble Rejection Sampling
di: Phan, Buu, et al.
Pubblicazione: (2025)

Matrix Completion via Nonsmooth Regularization of Fully Connected Neural Networks
di: Faramarzi, Sajad, et al.
Pubblicazione: (2024)

Generalization Bounds via Conditional $f$-Information
di: Wang, Ziqiao, et al.
Pubblicazione: (2024)