Circuit Complexity Bounds for RoPE-based Transformer Architecture

Documenti analoghi

• Theoretical Constraints on the Expressive Power of $\mathsf{RoPE}$-based Tensor Attention Transformers
  di: Li, Xiaoyu, et al.
  Pubblicazione: (2024)
• RoPE Attention Can Be Trained in Almost Linear Time
  di: Cao, Yang, et al.
  Pubblicazione: (2024)
• Circuit Complexity Bounds for Visual Autoregressive Model
  di: Ke, Yekun, et al.
  Pubblicazione: (2025)
• The Computational Limits of State-Space Models and Mamba via the Lens of Circuit Complexity
  di: Chen, Yifang, et al.
  Pubblicazione: (2024)
• On the Computational Capability of Graph Neural Networks: A Circuit Complexity Bound Perspective
  di: Li, Xiaoyu, et al.
  Pubblicazione: (2025)