Cover Image

CRoPE: Efficient Parametrization of Rotary Positional Embedding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lou, Beicheng, Xu, Zifei, Wong, Vivian W. H.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Matrix Implementation for Rotary Position Embedding
by: Minqi, Chen, et al.
Published: (2026)

Selective Rotary Position Embedding
by: Movahedi, Sajad, et al.
Published: (2025)

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
by: Liu, Feilong
Published: (2026)

Rotary Position Embedding for Vision Transformer
by: Heo, Byeongho, et al.
Published: (2024)

RoTHP: Rotary Position Embedding-based Transformer Hawkes Process
by: Gao, Anningzhe, et al.
Published: (2024)

DoPE: Denoising Rotary Position Embedding
by: Xiong, Jing, et al.
Published: (2025)

Rotary Position Encodings for Graphs
by: Reid, Isaac, et al.
Published: (2025)

The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval
by: Chiang, Ting-Rui, et al.
Published: (2025)

HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models
by: Li, Haoran, et al.
Published: (2025)

Tree-Structured Synergy of Large Language Models and Bayesian Optimization for Efficient CASH
by: Xu, Beicheng, et al.
Published: (2026)

Rethinking RoPE: A Mathematical Blueprint for N-dimensional Positional Embedding
by: Liu, Haiping, et al.
Published: (2025)

CRoC: Context Refactoring Contrast for Graph Anomaly Detection with Limited Supervision
by: Xie, Siyue, et al.
Published: (2025)

DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modeling
by: Zhao, Jianbo, et al.
Published: (2025)

SPECTRE: Spectral Pre-training Embeddings with Cylindrical Temporal Rotary Position Encoding for Fine-Grained sEMG-Based Movement Decoding
by: Weng, Zihan, et al.
Published: (2025)

Round and Round We Go! What makes Rotary Positional Encodings useful?
by: Barbero, Federico, et al.
Published: (2024)

MrRoPE: Mixed-radix Rotary Position Embedding
by: Tian, Qingyuan, et al.
Published: (2026)

CoFEH: LLM-driven Feature Engineering Empowered by Collaborative Bayesian Hyperparameter Optimization
by: Xu, Beicheng, et al.
Published: (2026)

PSEO: Optimizing Post-hoc Stacking Ensemble Through Hyperparameter Tuning
by: Xu, Beicheng, et al.
Published: (2025)

Rotary Masked Autoencoders are Versatile Learners
by: Zivanovic, Uros, et al.
Published: (2025)

VRoPE: Rotary Position Embedding for Video Large Language Models
by: Liu, Zikang, et al.
Published: (2025)

MF-QAT: Multi-Format Quantization-Aware Training for Elastic Inference
by: Xu, Zifei, et al.
Published: (2026)

CoPE: A Lightweight Complex Positional Encoding
by: Amballa, Avinash
Published: (2025)

CRoSS: A Continual Robotic Simulation Suite for Scalable Reinforcement Learning with High Task Diversity and Realistic Physics Simulation
by: Denker, Yannick, et al.
Published: (2026)

The Impact of Quantization on Large Reasoning Model Reinforcement Learning
by: Kumar, Medha, et al.
Published: (2025)

3-in-1: 2D Rotary Adaptation for Efficient Finetuning, Efficient Batching and Composability
by: Liao, Baohao, et al.
Published: (2024)

Non-Parametric Rehearsal Learning via Conditional Mean Embeddings
by: Du, Wen-Bo, et al.
Published: (2026)

FishRoPE: Projective Rotary Position Embeddings for Omnidirectional Visual Perception
by: Ahuja, Rahul, et al.
Published: (2026)

VideoRoPE: What Makes for Good Video Rotary Position Embedding?
by: Wei, Xilin, et al.
Published: (2025)

Rotary Offset Features in Large Language Models
by: Jonasson, André
Published: (2025)

Understanding the Difficulty of Low-Precision Post-Training Quantization for LLMs
by: Xu, Zifei, et al.
Published: (2024)

OpenBox: A Python Toolkit for Generalized Black-box Optimization
by: Jiang, Huaijun, et al.
Published: (2023)

Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane
by: Liu, Haoyu, et al.
Published: (2026)

CausalBench: A Comprehensive Benchmark for Causal Learning Capability of LLMs
by: Zhou, Yu, et al.
Published: (2024)

SeqPE: Transformer with Sequential Position Encoding
by: Li, Huayang, et al.
Published: (2025)

WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecasting
by: Liang, Aobo, et al.
Published: (2024)

Rethinking the Role of Positional Encoding: Sliding-Window Transformers without PE Remain Turing Complete
by: Li, Qian, et al.
Published: (2026)

Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
by: Urrutia, Felipe, et al.
Published: (2026)

Jordan-RoPE: Non-Semisimple Relative Positional Encoding via Complex Jordan Blocks
by: Zhang, Yaobo
Published: (2026)

CRePE: Convolution-aware Relative Importance in Post-training Pruning with Efficient Search
by: Park, Cheonjun
Published: (2026)

Machine Learning Framework for Thrombosis Risk Prediction in Rotary Blood Pumps
by: Blum, Christopher, et al.
Published: (2025)