On Fine-Grained I/O Complexity of Attention Backward Passes

Documenti analoghi

• Circuit Complexity Bounds for Visual Autoregressive Model
  di: Ke, Yekun, et al.
  Pubblicazione: (2025)
• Theoretical Constraints on the Expressive Power of $\mathsf{RoPE}$-based Tensor Attention Transformers
  di: Li, Xiaoyu, et al.
  Pubblicazione: (2024)
• The Computational Limits of State-Space Models and Mamba via the Lens of Circuit Complexity
  di: Chen, Yifang, et al.
  Pubblicazione: (2024)
• Circuit Complexity Bounds for RoPE-based Transformer Architecture
  di: Chen, Bo, et al.
  Pubblicazione: (2024)
• RoPE Attention Can Be Trained in Almost Linear Time
  di: Cao, Yang, et al.
  Pubblicazione: (2024)