SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training

Documenti analoghi

• STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data
  di: Wang, Daoce, et al.
  Pubblicazione: (2025)
• Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms
  di: Zhang, Yaozheng, et al.
  Pubblicazione: (2025)
• DynaShard: Secure and Adaptive Blockchain Sharding Protocol with Hybrid Consensus and Dynamic Shard Management
  di: Liu, Ao, et al.
  Pubblicazione: (2024)
• SP-Chain: Boosting Intra-Shard and Cross-Shard Security and Performance in Blockchain Sharding
  di: Li, Mingzhe, et al.
  Pubblicazione: (2024)
• InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding
  di: Chen, Qiaoling, et al.
  Pubblicazione: (2024)