Cover Image

Learning to Shard: RL for Co-optimizing the Parallelism Degrees and Per-operator Sharding Dimensions in Distributed LLM Inference

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yin, Ruokai, Mishra, Sattwik Deb, Zuo, Xuan, Tann, Hokchhay, Shah, Preyas, Guha, Apala
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SP-Chain: Boosting Intra-Shard and Cross-Shard Security and Performance in Blockchain Sharding
by: Li, Mingzhe, et al.
Published: (2024)

DynaShard: Secure and Adaptive Blockchain Sharding Protocol with Hybrid Consensus and Dynamic Shard Management
by: Liu, Ao, et al.
Published: (2024)

TRAIL: Cross-Shard Validation for Cryptocurrency Byzantine Shard Protection
by: Jacovetty, Mitch, et al.
Published: (2024)

StableShard: Stable and Scalable Blockchain Sharding with High Concurrency via Collaborative Committees
by: Li, Mingzhe, et al.
Published: (2024)

Fast Transaction Scheduling in Blockchain Sharding
by: Adhikari, Ramesh, et al.
Published: (2024)

EdgeShard: Efficient LLM Inference via Collaborative Edge Computing
by: Zhang, Mingjin, et al.
Published: (2024)

ShardTensor: Domain Parallelism for Scientific Machine Learning
by: Adams, Corey, et al.
Published: (2026)

HiCoCS: High Concurrency Cross-Sharding on Permissioned Blockchains
by: Yang, Lingxiao, et al.
Published: (2025)

Self-healing Nodes with Adaptive Data-Sharding
by: Thakur, Ayush, et al.
Published: (2024)

On the Efficiency of Dynamic Transaction Scheduling in Blockchain Sharding
by: Adhikari, Ramesh, et al.
Published: (2025)

Sharding Distributed Databases: A Critical Review
by: Solat, Siamak
Published: (2024)

Hecate: Unlocking Efficient Sparse Model Training via Fully Sharded Sparse Data Parallelism
by: Qing, Yuhao, et al.
Published: (2025)

A Hierarchical Sharded Blockchain Balancing Performance and Availability
by: Jo, Yongrae, et al.
Published: (2025)

Dynamically Sharded Ledgers on a Distributed Hash Table
by: Fink, Christoffer, et al.
Published: (2024)

Stable Blockchain Sharding under Adversarial Transaction Generation
by: Adhikari, Ramesh, et al.
Published: (2024)

Investigating Sharding Advancements, Methodologies, and Adoption Potential in Hedera
by: Wang, Ziwei, et al.
Published: (2025)

SpiralShard: Highly Concurrent and Secure Blockchain Sharding via Linked Cross-shard Endorsement
by: Lin, You, et al.
Published: (2024)

SimpleFSDP: Simpler Fully Sharded Data Parallel with torch.compile
by: Zhang, Ruisi, et al.
Published: (2024)

Memory and Bandwidth are All You Need for Fully Sharded Data Parallel
by: Wang, Jiangtao, et al.
Published: (2025)

Near-Optimal Stability for Distributed Transaction Processing in Blockchain Sharding
by: Adhikari, Ramesh, et al.
Published: (2025)

SmartShards: Churn-Tolerant Continuously Available Distributed Ledger
by: Oglio, Joseph, et al.
Published: (2025)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding
by: Chen, Qiaoling, et al.
Published: (2024)

SAMM: Sharded Automated Market Maker
by: Chen, Hongyin, et al.
Published: (2024)

Automated Market Makers for Cross-chain DeFi and Sharded Blockchains
by: Aanes, Jon Michael, et al.
Published: (2023)

AI-driven Predictive Shard Allocation for Scalable Next Generation Blockchains
by: Haider, M. Zeeshan, et al.
Published: (2025)

Helix Parallelism: Rethinking Sharding Strategies for Interactive Multi-Million-Token LLM Decoding
by: Bhatia, Nidhi, et al.
Published: (2025)

Accelerating MoE Model Inference with Expert Sharding
by: Balmau, Oana, et al.
Published: (2025)

Advancing Blockchain Scalability: A Linear Optimization Framework for Diversified Node Allocation in Shards
by: Assmann, Björn, et al.
Published: (2024)

Sedna: Sharding transactions in multiple concurrent proposer blockchains
by: Ranchal-Pedrosa, Alejandro, et al.
Published: (2025)

SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
by: Jia, Jinda, et al.
Published: (2024)

BlockEmulator: An Emulator Enabling to Test Blockchain Sharding Protocols
by: Huang, Huawei, et al.
Published: (2023)

Model Agnostic Hybrid Sharding For Heterogeneous Distributed Inference
by: Angione, Claudio, et al.
Published: (2024)

Enhancing Split Learning with Sharded and Blockchain-Enabled SplitFed Approaches
by: Sokhankhosh, Amirreza, et al.
Published: (2025)

A Range-Based Sharding (RBS) Protocol for Scalable Enterprise Blockchain
by: Haider, M. Z., et al.
Published: (2025)

Shard the Gradient, Scale the Model: Serverless Federated Aggregation via Gradient Partitioning
by: Barrak, Amine
Published: (2026)

A Sharded Blockchain-Based Secure Federated Learning Framework for LEO Satellite Networks
by: Wu, Wenbo, et al.
Published: (2024)

A Two-Layer Blockchain Sharding Protocol Leveraging Safety and Liveness for Enhanced Performance
by: Xu, Yibin, et al.
Published: (2023)

Sharded Elimination and Combining for Highly-Efficient Concurrent Stacks
by: Singh, Ajay, et al.
Published: (2026)

Mosaic: Client-driven Account Allocation Framework in Sharded Blockchains
by: Zhang, Yuanzhe, et al.
Published: (2025)

DRDST: Low-latency DAG Consensus through Robust Dynamic Sharding and Tree-broadcasting for IoV
by: Chen, Runhua, et al.
Published: (2024)