Imagen de Portada

Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Haoyu, Ren, Sucheng, Zhu, Tingyu, Wang, Peng, Xie, Cihang, Yuille, Alan, Zheng, Zeyu, Wang, Feng
Formato:	Preprint
Publicado:	2026
Materias:	Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

CoPE: Clipped RoPE as A Scalable Free Lunch for Long Context LLMs
por: Li, Haoran, et al.
Publicado: (2026)

Diffusion MRI Transformer with a Diffusion Space Rotary Positional Embedding (D-RoPE)
por: Kung, Gustavo Chau Loo, et al.
Publicado: (2026)

Adaptive 3D-RoPE: Physics-Aligned Rotary Positional Encoding for Wireless Foundation Models
por: Zhang, Chenyu, et al.
Publicado: (2026)

MrRoPE: Mixed-radix Rotary Position Embedding
por: Tian, Qingyuan, et al.
Publicado: (2026)

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
por: Liu, Feilong
Publicado: (2026)

Rejuvenating image-GPT as Strong Visual Representation Learners
por: Ren, Sucheng, et al.
Publicado: (2023)

M-VAR: Decoupled Scale-wise Autoregressive Modeling for High-Quality Image Generation
por: Ren, Sucheng, et al.
Publicado: (2024)

Rethinking RoPE: A Mathematical Blueprint for N-dimensional Positional Embedding
por: Liu, Haiping, et al.
Publicado: (2025)

VideoRoPE: What Makes for Good Video Rotary Position Embedding?
por: Wei, Xilin, et al.
Publicado: (2025)

ARVideo: Autoregressive Pretraining for Self-Supervised Video Representation Learning
por: Ren, Sucheng, et al.
Publicado: (2024)

RoPE-LIME: RoPE-Space Locality + Sparse-K Sampling for Efficient LLM Attribution
por: Picov, Isaac, et al.
Publicado: (2026)

FishRoPE: Projective Rotary Position Embeddings for Omnidirectional Visual Perception
por: Ahuja, Rahul, et al.
Publicado: (2026)

ViT-5: Vision Transformers for The Mid-2020s
por: Wang, Feng, et al.
Publicado: (2026)

Rotate Both Ways: Time-and-Order RoPE for Generative Recommendation
por: Wei, Xiaokai, et al.
Publicado: (2025)

Base of RoPE Bounds Context Length
por: Men, Xin, et al.
Publicado: (2024)

ReRoPE: Repurposing RoPE for Relative Camera Control
por: Li, Chunyang, et al.
Publicado: (2026)

RoPE Distinguishes Neither Positions Nor Tokens in Long Contexts, Provably
por: Du, Yufeng, et al.
Publicado: (2026)

Fractional Rotation, Full Potential? Investigating Performance and Convergence of Partial RoPE
por: Khan, Mohammad Aflah, et al.
Publicado: (2026)

ViMix-14M: A Curated Multi-Source Video-Text Dataset with Long-Form, High-Quality Captions and Crawl-Free Access
por: Yang, Timing, et al.
Publicado: (2025)

Periodic RoPE for Infinite Context LLMs
por: Huo, Simin
Publicado: (2026)

Scaling Laws of RoPE-based Extrapolation
por: Liu, Xiaoran, et al.
Publicado: (2023)

When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
por: Wang, Haonan, et al.
Publicado: (2024)

Resonance RoPE: Improving Context Length Generalization of Large Language Models
por: Wang, Suyuchen, et al.
Publicado: (2024)

Frayed RoPE and Long Inputs: A Geometric Perspective
por: Wertheimer, Davis, et al.
Publicado: (2026)

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration
por: Yang, Ning, et al.
Publicado: (2026)

Demystifying the Slash Pattern in Attention: The Role of RoPE
por: Cheng, Yuan, et al.
Publicado: (2026)

ComRoPE: Scalable and Robust Rotary Position Embedding Parameterized by Trainable Commuting Angle Matrices
por: Yu, Hao, et al.
Publicado: (2025)

DoPE: Denoising Rotary Position Embedding
por: Xiong, Jing, et al.
Publicado: (2025)

DTT-BSR: GAN-based DTTNet with RoPE Transformer Enhancement for Music Source Restoration
por: Tan, Shihong, et al.
Publicado: (2026)

Mamba-R: Vision Mamba ALSO Needs Registers
por: Wang, Feng, et al.
Publicado: (2024)

Shuffle the Context: RoPE-Perturbed Self-Distillation for Long-Context Adaptation
por: Li, Zichong, et al.
Publicado: (2026)

RoPE Attention Can Be Trained in Almost Linear Time
por: Cao, Yang, et al.
Publicado: (2024)

Circuit Complexity Bounds for RoPE-based Transformer Architecture
por: Chen, Bo, et al.
Publicado: (2024)

Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
por: Urrutia, Felipe, et al.
Publicado: (2026)

Jordan-RoPE: Non-Semisimple Relative Positional Encoding via Complex Jordan Blocks
por: Zhang, Yaobo
Publicado: (2026)

CRoPE: Efficient Parametrization of Rotary Positional Embedding
por: Lou, Beicheng, et al.
Publicado: (2026)

PhaseWrap-RoPE: Bounded Phase-Wrap Positional Scoring Evidence and Hardware-Validation Tooling
por: Fredriksen, Daniel Eric
Publicado: (2026)

PhaseWrap-RoPE: Bounded Phase-Wrap Positional Scoring Evidence and Hardware-Validation Tooling
por: Fredriksen, Daniel Eric
Publicado: (2026)

PhaseWrap-RoPE: Bounded Phase-Wrap Positional Scoring Evidence and Hardware-Validation Tooling
por: Fredriksen, Daniel Eric
Publicado: (2026)

PhaseWrap-RoPE: Bounded Phase-Wrap Positional Scoring Evidence and Hardware-Validation Tooling
por: Fredriksen, Daniel Eric
Publicado: (2026)