DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs
Fuente:
arXiv
Saved in:
| Main Authors: | Zheng, Size, Zheng, Xuegui, Sun, Hanshi, Hou, Qi, Bao, Wenlei, Li, Shiyu, Duanmu, Haojie, Fang, Jin, Xue, Chenli, Huang, Chenhui, Liu, Yuanqiang, Chen, Renze, Zheng, Ningxin, Wang, Dongyang, Chang, Li-Wen, Lu, Liqiang, Liang, Yun, Zhai, Jidong, Liu, Xin |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler
by: Zheng, Size, et al.
Published: (2025)
by: Zheng, Size, et al.
Published: (2025)
UniEP: Unified Expert-Parallel MoE MegaKernel for LLM Training
by: Zheng, Size, et al.
Published: (2026)
by: Zheng, Size, et al.
Published: (2026)
TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives
by: Zheng, Size, et al.
Published: (2025)
by: Zheng, Size, et al.
Published: (2025)
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
by: Sun, Hanshi, et al.
Published: (2024)
by: Sun, Hanshi, et al.
Published: (2024)
Optimizing Long-context LLM Serving via Fine-grained Sequence Parallelism
by: Li, Cong, et al.
Published: (2025)
by: Li, Cong, et al.
Published: (2025)
MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design
by: Duanmu, Haojie, et al.
Published: (2025)
by: Duanmu, Haojie, et al.
Published: (2025)
Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts
by: Zhang, Shulai, et al.
Published: (2025)
by: Zhang, Shulai, et al.
Published: (2025)
vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs
by: Zheng, Size, et al.
Published: (2024)
by: Zheng, Size, et al.
Published: (2024)
ZeroPP: Unleashing Exceptional Parallelism Efficiency through Tensor-Parallelism-Free Methodology
by: Tang, Ding, et al.
Published: (2024)
by: Tang, Ding, et al.
Published: (2024)
Optimal Kernel Orchestration for Tensor Programs with Korch
by: Hu, Muyan, et al.
Published: (2024)
by: Hu, Muyan, et al.
Published: (2024)
MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
by: Jin, Chao, et al.
Published: (2025)
by: Jin, Chao, et al.
Published: (2025)
GraphNet: A Large-Scale Computational Graph Dataset for Tensor Compiler Research
by: Li, Xinqi, et al.
Published: (2025)
by: Li, Xinqi, et al.
Published: (2025)
Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels
by: Zhao, Yifan, et al.
Published: (2026)
by: Zhao, Yifan, et al.
Published: (2026)
WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More
by: Yue, Yuxuan, et al.
Published: (2024)
by: Yue, Yuxuan, et al.
Published: (2024)
Time-frequency Entangled Photon Mediated CCZ Gate
by: Wang, Chenhui, et al.
Published: (2025)
by: Wang, Chenhui, et al.
Published: (2025)
DisagMoE: Computation-Communication overlapped MoE Training via Disaggregated AF-Pipe Parallelism
by: Zeng, Zhichen, et al.
Published: (2026)
by: Zeng, Zhichen, et al.
Published: (2026)
TEON: Tensorized Orthonormalization Beyond Layer-Wise Muon for Large Language Model Pre-Training
by: Zhang, Ruijie, et al.
Published: (2026)
by: Zhang, Ruijie, et al.
Published: (2026)
NanoCP: Request-Level Dynamic Context Parallelism for Data-Expert Parallel Decoding
by: Chen, Jiefei, et al.
Published: (2026)
by: Chen, Jiefei, et al.
Published: (2026)
Physics-Aware Compilation for Parallel Quantum Circuit Execution on Neutral Atom Arrays
by: Chen, Geng, et al.
Published: (2025)
by: Chen, Geng, et al.
Published: (2025)
TACO: Efficient Communication Compression of Intermediate Tensors for Scalable Tensor-Parallel LLM Training
by: Liu, Man, et al.
Published: (2026)
by: Liu, Man, et al.
Published: (2026)
SpecRouter: Adaptive Routing for Multi-Level Speculative Decoding in Large Language Models
by: Wu, Hang, et al.
Published: (2025)
by: Wu, Hang, et al.
Published: (2025)
Approximate universality and large measurement gain of Rabi model in a linear potential under strong Doppler broadening
by: Yu, Dongyang, et al.
Published: (2025)
by: Yu, Dongyang, et al.
Published: (2025)
Effect of Luteolin Supplementation on Kidney Damage and Long‐Term Prognosis in Diabetic Patients: A Cohort Study
by: Li Li, et al.
Published: (2026)
by: Li Li, et al.
Published: (2026)
The $K_{1,2}$-structure-connectivity of graphs
by: Zhao, Xiao, et al.
Published: (2024)
by: Zhao, Xiao, et al.
Published: (2024)
DynaMo: Runtime Switchable Quantization for MoE with Cross-Dataset Adaptation
by: Zheng, Zihao, et al.
Published: (2025)
by: Zheng, Zihao, et al.
Published: (2025)
Obstructions to Unitary Hamiltonians in Non-Unitary String-Net Models
by: Yang, Hanshi
Published: (2026)
by: Yang, Hanshi
Published: (2026)
FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework
by: Zhu, Jianian, et al.
Published: (2025)
by: Zhu, Jianian, et al.
Published: (2025)
FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion
by: Chang, Li-Wen, et al.
Published: (2024)
by: Chang, Li-Wen, et al.
Published: (2024)
Robust Subspace-Constrained Quadratic Models for Low-Dimensional Structure Learning
by: Zhai, Zheng, et al.
Published: (2026)
by: Zhai, Zheng, et al.
Published: (2026)
Subspace-Constrained Quadratic Matrix Factorization: Algorithm and Applications
by: Zhai, Zheng, et al.
Published: (2024)
by: Zhai, Zheng, et al.
Published: (2024)
Agentic Harness for Real-World Compilers
by: Zheng, Yingwei, et al.
Published: (2026)
by: Zheng, Yingwei, et al.
Published: (2026)
The conditional colour-magnitude distribution: II. A comparison of galaxy colour and luminosity distribution in galaxy groups
by: Xu, Haojie, et al.
Published: (2023)
by: Xu, Haojie, et al.
Published: (2023)
A Flexible Programmable Pipeline Parallelism Framework for Efficient DNN Training
by: Jiang, Lijuan, et al.
Published: (2025)
by: Jiang, Lijuan, et al.
Published: (2025)
SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
by: Duanmu, Haojie, et al.
Published: (2024)
by: Duanmu, Haojie, et al.
Published: (2024)
Driving corporate social responsibility to be innovative: Insights from a systematic literature review
by: Liming Zhao, et al.
Published: (2024)
by: Liming Zhao, et al.
Published: (2024)
Tensor Stochastic Regression for High-dimensional Time Series via CP Decomposition
by: Li, Shibo, et al.
Published: (2025)
by: Li, Shibo, et al.
Published: (2025)
HARMONY: A Scalable Distributed Vector Database for High-Throughput Approximate Nearest Neighbor Search
by: Xu, Qian, et al.
Published: (2025)
by: Xu, Qian, et al.
Published: (2025)
Extended (tri)dendriform algebras, pre-Lie algebras and post-Lie algebras as companion structures of extended Rota-Baxter algebras
by: Zheng, Shanghua, et al.
Published: (2024)
by: Zheng, Shanghua, et al.
Published: (2024)
FastDecode: High-Throughput GPU-Efficient LLM Serving using Heterogeneous Pipelines
by: He, Jiaao, et al.
Published: (2024)
by: He, Jiaao, et al.
Published: (2024)
Neuroprotective Effects of Triterpenoids From Rosa laevigata Root: Identification, Molecular Docking, and In Vitro Evaluation for Alzheimer's Disease Treatment
by: Fei Xu, et al.
Published: (2025)
by: Fei Xu, et al.
Published: (2025)
Similar Items
-
Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler
by: Zheng, Size, et al.
Published: (2025) -
UniEP: Unified Expert-Parallel MoE MegaKernel for LLM Training
by: Zheng, Size, et al.
Published: (2026) -
TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives
by: Zheng, Size, et al.
Published: (2025) -
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
by: Sun, Hanshi, et al.
Published: (2024) -
Optimizing Long-context LLM Serving via Fine-grained Sequence Parallelism
by: Li, Cong, et al.
Published: (2025)