Efficient Learned Data Compression via Dual-Stream Feature Decoupling

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ma, Huidong, Shi, Xinyan, Sun, Hui, Yue, Xiaofei, Liu, Xiaoguang, Wang, Gang, Cai, Wentong
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908947857801216
author Ma, Huidong
Shi, Xinyan
Sun, Hui
Yue, Xiaofei
Liu, Xiaoguang
Wang, Gang
Cai, Wentong
author_facet Ma, Huidong
Shi, Xinyan
Sun, Hui
Yue, Xiaofei
Liu, Xiaoguang
Wang, Gang
Cai, Wentong
contents While Learned Data Compression (LDC) has achieved superior compression ratios, balancing precise probability modeling with system efficiency remains challenging. Crucially, uniform single-stream architectures struggle to simultaneously capture micro-syntactic and macro-semantic features, necessitating deep serial stacking that exacerbates latency. Compounding this, heterogeneous systems are constrained by device speed mismatches, where throughput is capped by Amdahl's Law due to serial processing. To this end, we propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams, and incorporate a Hierarchical Gated Refiner for adaptive feature refinement and precise probability modeling. Furthermore, we design a Concurrent Stream-Parallel Pipeline, which overcomes systemic bottlenecks to achieve full-pipeline parallelism. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both compression ratio and throughput, while maintaining the lowest latency and memory usage. The code is available at https://github.com/huidong-ma/FADE.
format Preprint
id arxiv_https___arxiv_org_abs_2604_07239
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Efficient Learned Data Compression via Dual-Stream Feature Decoupling
Ma, Huidong
Shi, Xinyan
Sun, Hui
Yue, Xiaofei
Liu, Xiaoguang
Wang, Gang
Cai, Wentong
Computation and Language
Information Theory
Machine Learning
While Learned Data Compression (LDC) has achieved superior compression ratios, balancing precise probability modeling with system efficiency remains challenging. Crucially, uniform single-stream architectures struggle to simultaneously capture micro-syntactic and macro-semantic features, necessitating deep serial stacking that exacerbates latency. Compounding this, heterogeneous systems are constrained by device speed mismatches, where throughput is capped by Amdahl's Law due to serial processing. To this end, we propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams, and incorporate a Hierarchical Gated Refiner for adaptive feature refinement and precise probability modeling. Furthermore, we design a Concurrent Stream-Parallel Pipeline, which overcomes systemic bottlenecks to achieve full-pipeline parallelism. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both compression ratio and throughput, while maintaining the lowest latency and memory usage. The code is available at https://github.com/huidong-ma/FADE.
title Efficient Learned Data Compression via Dual-Stream Feature Decoupling
topic Computation and Language
Information Theory
Machine Learning
url https://arxiv.org/abs/2604.07239