FT-Transformer: Resilient and Reliable Transformer with End-to-End Fault Tolerant Attention
Fuente:
arXiv
Saved in:
| Main Authors: | Dai, Huangliang, Wu, Shixun, Huang, Jiajun, Jian, Zizhe, Zhu, Yue, Hu, Haiyang, Chen, Zizhong |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU
by: Wu, Shixun, et al.
Published: (2024)
by: Wu, Shixun, et al.
Published: (2024)
TurboFFT: Co-Designed High-Performance and Fault-Tolerant Fast Fourier Transform on GPUs
by: Wu, Shixun, et al.
Published: (2024)
by: Wu, Shixun, et al.
Published: (2024)
FT K-means: A High-Performance K-means on GPU with Fault Tolerance
by: Wu, Shixun, et al.
Published: (2024)
by: Wu, Shixun, et al.
Published: (2024)
TurboFNO: High-Performance Fourier Neural Operator with Fused FFT-GEMM-iFFT on GPU
by: Wu, Shixun, et al.
Published: (2025)
by: Wu, Shixun, et al.
Published: (2025)
DGRO: Diameter-Guided Ring Optimization for Integrated Research Infrastructure Membership
by: Wu, Shixun, et al.
Published: (2024)
by: Wu, Shixun, et al.
Published: (2024)
BlockRaFT: A Distributed Framework for Fault-Tolerant and Scalable Blockchain Nodes
by: Piduguralla, Manaswini, et al.
Published: (2026)
by: Piduguralla, Manaswini, et al.
Published: (2026)
High-performance Effective Scientific Error-bounded Lossy Compression with Auto-tuned Multi-component Interpolation
by: Liu, Jinyang, et al.
Published: (2023)
by: Liu, Jinyang, et al.
Published: (2023)
Boosting Scientific Error-Bounded Lossy Compression through Optimized Synergistic Lossy-Lossless Orchestration
by: Wu, Shixun, et al.
Published: (2025)
by: Wu, Shixun, et al.
Published: (2025)
ClusterRCA: An End-to-End Approach for Network Fault Localization and Classification for HPC System
by: Sun, Yongqian, et al.
Published: (2025)
by: Sun, Yongqian, et al.
Published: (2025)
A Heterogeneous Chiplet Architecture for Accelerating End-to-End Transformer Models
by: Sharma, Harsh, et al.
Published: (2023)
by: Sharma, Harsh, et al.
Published: (2023)
cuSZ-$i$: High-Ratio Scientific Lossy Compression on GPUs with Optimized Multi-Level Interpolation
by: Liu, Jinyang, et al.
Published: (2023)
by: Liu, Jinyang, et al.
Published: (2023)
Efficient Fault Localization in a Cloud Stack Using End-to-End Application Service Topology
by: Mathews, Dhanya R, et al.
Published: (2025)
by: Mathews, Dhanya R, et al.
Published: (2025)
Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
by: Wang, Yuxin, et al.
Published: (2023)
by: Wang, Yuxin, et al.
Published: (2023)
Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge
by: Wu, Yebo, et al.
Published: (2026)
by: Wu, Yebo, et al.
Published: (2026)
Half a Century of Distributed Byzantine Fault-Tolerant Consensus: Design Principles and Evolutionary Pathways
by: Wu, Huanyu, et al.
Published: (2024)
by: Wu, Huanyu, et al.
Published: (2024)
Beyond Optimal Fault Tolerance
by: Lewis-Pye, Andrew, et al.
Published: (2025)
by: Lewis-Pye, Andrew, et al.
Published: (2025)
Chameleon: Adaptive Fault Tolerance for Distributed Training via Real-time Policy Selection
by: Zhou, Yuhang, et al.
Published: (2025)
by: Zhou, Yuhang, et al.
Published: (2025)
FTI-TMR: A Fault Tolerance and Isolation Algorithm for Interconnected Multicore Systems
by: Hu, Yiming
Published: (2025)
by: Hu, Yiming
Published: (2025)
A Proposed End-To-End Principle for Data Commons
by: Grossman, Robert L.
Published: (2025)
by: Grossman, Robert L.
Published: (2025)
VBFT: Veloce Byzantine Fault Tolerant Consensus for Blockchains
by: Jalalzai, Mohammad M., et al.
Published: (2023)
by: Jalalzai, Mohammad M., et al.
Published: (2023)
End-to-End and Phase-Level Performance Optimization for Hyperledger Fabric
by: Sollu, Pavan, et al.
Published: (2026)
by: Sollu, Pavan, et al.
Published: (2026)
Byzantine Fault Tolerant Causal Ordering
by: Misra, Anshuman, et al.
Published: (2021)
by: Misra, Anshuman, et al.
Published: (2021)
Saarthi: An End-to-End Intelligent Platform for Optimising Distributed Serverless Workloads
by: Agarwal, Siddharth, et al.
Published: (2025)
by: Agarwal, Siddharth, et al.
Published: (2025)
Odyssey: An End-to-End System for Pareto-Optimal Serverless Query Processing
by: Jesalpura, Shyam, et al.
Published: (2025)
by: Jesalpura, Shyam, et al.
Published: (2025)
Optimizing View Change for Byzantine Fault Tolerance in Parallel Consensus
by: Xie, Yifei, et al.
Published: (2026)
by: Xie, Yifei, et al.
Published: (2026)
Byzantine Fault-Tolerant Min-Max Optimization
by: Liu, Shuo, et al.
Published: (2022)
by: Liu, Shuo, et al.
Published: (2022)
Approximate Byzantine Fault-Tolerance in Distributed Optimization
by: Liu, Shuo, et al.
Published: (2021)
by: Liu, Shuo, et al.
Published: (2021)
Optimal Fault-Tolerant Dispersion on Oriented Grids
by: Banerjee, Rik, et al.
Published: (2024)
by: Banerjee, Rik, et al.
Published: (2024)
Probabilistic Byzantine Fault Tolerance (Extended Version)
by: Avelãs, Diogo, et al.
Published: (2024)
by: Avelãs, Diogo, et al.
Published: (2024)
Amortized Asynchronous Byzantine Reliable Broadcast with Optimal Resilience
by: Hu, Michael Yiqing, et al.
Published: (2026)
by: Hu, Michael Yiqing, et al.
Published: (2026)
Improving the End-to-End Efficiency of Offline Inference for Multi-LLM Applications Based on Sampling and Simulation
by: Fang, Jingzhi, et al.
Published: (2025)
by: Fang, Jingzhi, et al.
Published: (2025)
Cost-Effective Edge Data Distribution with End-To-End Delay Guarantees in Edge Computing
by: Shankar, Ravi, et al.
Published: (2025)
by: Shankar, Ravi, et al.
Published: (2025)
A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO
by: Svedas, Jonas, et al.
Published: (2025)
by: Svedas, Jonas, et al.
Published: (2025)
Optimizing Robot Dispersion on Grids: with and without Fault Tolerance
by: Banerjee, Rik, et al.
Published: (2024)
by: Banerjee, Rik, et al.
Published: (2024)
A Fault Tolerance Mechanism for Hybrid Scientific Workflows
by: Mulone, Alberto, et al.
Published: (2024)
by: Mulone, Alberto, et al.
Published: (2024)
Asynchronous Fault-Tolerant Distributed Proper Coloring of Graphs
by: Balliu, Alkida, et al.
Published: (2024)
by: Balliu, Alkida, et al.
Published: (2024)
Arma: Byzantine Fault Tolerant Consensus with Horizontal Scalability
by: Manevich, Yacov, et al.
Published: (2024)
by: Manevich, Yacov, et al.
Published: (2024)
The Case for ABI Interoperability in a Fault Tolerant MPI
by: Xu, Yao, et al.
Published: (2025)
by: Xu, Yao, et al.
Published: (2025)
MeCeFO: Enhancing LLM Training Robustness via Fault-Tolerant Optimization
by: Hu, Rizhen, et al.
Published: (2025)
by: Hu, Rizhen, et al.
Published: (2025)
Stabl: Blockchain Fault Tolerance
by: Gramoli, Vincent, et al.
Published: (2024)
by: Gramoli, Vincent, et al.
Published: (2024)
Similar Items
-
TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU
by: Wu, Shixun, et al.
Published: (2024) -
TurboFFT: Co-Designed High-Performance and Fault-Tolerant Fast Fourier Transform on GPUs
by: Wu, Shixun, et al.
Published: (2024) -
FT K-means: A High-Performance K-means on GPU with Fault Tolerance
by: Wu, Shixun, et al.
Published: (2024) -
TurboFNO: High-Performance Fourier Neural Operator with Fused FFT-GEMM-iFFT on GPU
by: Wu, Shixun, et al.
Published: (2025) -
DGRO: Diameter-Guided Ring Optimization for Integrated Research Infrastructure Membership
by: Wu, Shixun, et al.
Published: (2024)