Imagen de Portada

Accelerating Communication in Deep Learning Recommendation Model Training with Dual-Level Adaptive Lossy Compression

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Feng, Hao, Zhang, Boyuan, Ye, Fanjiang, Si, Min, Chu, Ching-Hsiang, Tian, Jiannan, Yin, Chunxing, Deng, Summer, Hao, Yuchen, Balaji, Pavan, Geng, Tong, Tao, Dingwen
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Distributed, Parallel, and Cluster Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

cuSZ-$i$: High-Ratio Scientific Lossy Compression on GPUs with Optimized Multi-Level Interpolation
por: Liu, Jinyang, et al.
Publicado: (2023)

Overcoming Memory Constraints in Quantum Circuit Simulation with a High-Fidelity Compression Framework
por: Zhang, Boyuan, et al.
Publicado: (2024)

A Survey on Error-Bounded Lossy Compression for Scientific Datasets
por: Di, Sheng, et al.
Publicado: (2024)

Boosting Scientific Error-Bounded Lossy Compression through Optimized Synergistic Lossy-Lossless Orchestration
por: Wu, Shixun, et al.
Publicado: (2025)

STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data
por: Wang, Daoce, et al.
Publicado: (2025)

GPZ: GPU-Accelerated Lossy Compressor for Particle Data
por: Li, Ruoyu, et al.
Publicado: (2025)

FLARE: A Dataflow-Aware and Scalable Hardware Architecture for Neural-Hybrid Scientific Lossy Compression
por: Jia, Wenqi, et al.
Publicado: (2025)

NeurLZ: An Online Neural Learning-Based Method to Enhance Scientific Lossy Compression
por: Jia, Wenqi, et al.
Publicado: (2024)

GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Data
por: Jia, Wenqi, et al.
Publicado: (2024)

LCP: Enhancing Scientific Data Management with Lossy Compression for Particles
por: Zhang, Longtao, et al.
Publicado: (2024)

To Compress or Not To Compress: Energy Trade-Offs and Benefits of Lossy Compressed I/O
por: Wilkins, Grant, et al.
Publicado: (2024)

IPComp: Interpolation Based Progressive Lossy Compression for Scientific Applications
por: Yang, Zhuoxun, et al.
Publicado: (2025)

ZCCL: Significantly Improving Collective Communication With Error-Bounded Lossy Compression
por: Huang, Jiajun, et al.
Publicado: (2025)

An Optimized Error-controlled MPI Collective Framework Integrated with Lossy Compression
por: Huang, Jiajun, et al.
Publicado: (2023)

FZModules: A Heterogeneous Computing Framework for Customizable Scientific Data Compression Pipelines
por: Ruiter, Skyler, et al.
Publicado: (2025)

FedSZ: Leveraging Error-Bounded Lossy Compression for Federated Learning Communications
por: Wilkins, Grant, et al.
Publicado: (2023)

Fast Topology-Aware Lossy Data Compression with Full Preservation of Critical Points and Local Order
por: Fallin, Alex, et al.
Publicado: (2026)

ZipCCL: Efficient Lossless Data Compression of Communication Collectives for Accelerating LLM Training
por: Lin, Wenxiang, et al.
Publicado: (2026)

EXaCTz: Guaranteed Extremum Graph and Contour Tree Preservation for Distributed- and GPU-Parallel Lossy Compression
por: Li, Yuxiao, et al.
Publicado: (2026)

pMSz: A Distributed Parallel Algorithm for Correcting Extrema and Morse Smale Segmentations in Lossy Compression
por: Li, Yuxiao, et al.
Publicado: (2026)

Preserving Clusters in Error-Bounded Lossy Compression of Particle Data
por: Ren, Congrong, et al.
Publicado: (2026)

KVComp: A High-Performance, LLM-Aware, Lossy Compression Framework for KV Cache
por: Jiang, Bo, et al.
Publicado: (2025)

Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation
por: Luo, Liang, et al.
Publicado: (2024)

TACO: Efficient Communication Compression of Intermediate Tensors for Scalable Tensor-Parallel LLM Training
por: Liu, Man, et al.
Publicado: (2026)

PackKV: Reducing KV Cache Memory Footprint through LLM-Aware Lossy Compression
por: Jiang, Bo, et al.
Publicado: (2025)

Lessons Learned on the Path to Guaranteeing the Error Bound in Lossy Quantizers
por: Fallin, Alex, et al.
Publicado: (2024)

FFCz: Fast Fourier Correction for Spectrum-Preserving Lossy Compression of Scientific Data
por: Ren, Congrong, et al.
Publicado: (2026)

A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization
por: Wang, Daoce, et al.
Publicado: (2024)

Accelerating Large Language Model Training with Hybrid GPU-based Compression
por: Xu, Lang, et al.
Publicado: (2024)

TurboGR: An Accelerated Training System for Large-Scale Generative Recommendation
por: Chai, Huichao, et al.
Publicado: (2026)

DeepCQ: General-Purpose Deep-Surrogate Framework for Lossy Compression Quality Prediction
por: Mumenin, Khondoker Mirazul, et al.
Publicado: (2025)

Enhancing Lossy Compression Through Cross-Field Information for Scientific Applications
por: Liu, Youyuan, et al.
Publicado: (2024)

A Data-Informed Local Subspaces Method for Error-Bounded Lossy Compression of Large-Scale Scientific Datasets
por: Khan, Arshan, et al.
Publicado: (2026)

Lossy Data Compression By Adaptive Mesh Coarsening
por: Böing, N., et al.
Publicado: (2024)

HoSZp: An Efficient Homomorphic Error-bounded Lossy Compressor for Scientific Data
por: Agarwal, Tripti, et al.
Publicado: (2024)

DreamDDP: Accelerating Data Parallel Distributed LLM Training with Layer-wise Scheduled Partial Synchronization
por: Tang, Zhenheng, et al.
Publicado: (2025)

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters
por: Huang, Jiajun, et al.
Publicado: (2023)

StraightLine: An End-to-End Resource-Aware Scheduler for Machine Learning Application Requests
por: Ching, Cheng-Wei, et al.
Publicado: (2024)

Warp-STAR: High-performance, Differentiable GPU-Accelerated Static Timing Analysis through Warp-oriented Parallel Orchestration
por: Huang, En-Ming, et al.
Publicado: (2026)

Accelerating Compound LLM Training Workloads with Maestro
por: Yuan, Xiulong, et al.
Publicado: (2026)