Image de couverture de livre

CRoPE: Efficient Parametrization of Rotary Positional Embedding

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lou, Beicheng, Xu, Zifei, Wong, Vivian W. H.
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Efficient Matrix Implementation for Rotary Position Embedding
par: Minqi, Chen, et autres
Publié: (2026)

Selective Rotary Position Embedding
par: Movahedi, Sajad, et autres
Publié: (2025)

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
par: Liu, Feilong
Publié: (2026)

Rotary Position Embedding for Vision Transformer
par: Heo, Byeongho, et autres
Publié: (2024)

RoTHP: Rotary Position Embedding-based Transformer Hawkes Process
par: Gao, Anningzhe, et autres
Publié: (2024)

DoPE: Denoising Rotary Position Embedding
par: Xiong, Jing, et autres
Publié: (2025)

Rotary Position Encodings for Graphs
par: Reid, Isaac, et autres
Publié: (2025)

The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval
par: Chiang, Ting-Rui, et autres
Publié: (2025)

HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models
par: Li, Haoran, et autres
Publié: (2025)

Tree-Structured Synergy of Large Language Models and Bayesian Optimization for Efficient CASH
par: Xu, Beicheng, et autres
Publié: (2026)

Rethinking RoPE: A Mathematical Blueprint for N-dimensional Positional Embedding
par: Liu, Haiping, et autres
Publié: (2025)

CRoC: Context Refactoring Contrast for Graph Anomaly Detection with Limited Supervision
par: Xie, Siyue, et autres
Publié: (2025)

DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modeling
par: Zhao, Jianbo, et autres
Publié: (2025)

SPECTRE: Spectral Pre-training Embeddings with Cylindrical Temporal Rotary Position Encoding for Fine-Grained sEMG-Based Movement Decoding
par: Weng, Zihan, et autres
Publié: (2025)

Round and Round We Go! What makes Rotary Positional Encodings useful?
par: Barbero, Federico, et autres
Publié: (2024)

MrRoPE: Mixed-radix Rotary Position Embedding
par: Tian, Qingyuan, et autres
Publié: (2026)

CoFEH: LLM-driven Feature Engineering Empowered by Collaborative Bayesian Hyperparameter Optimization
par: Xu, Beicheng, et autres
Publié: (2026)

PSEO: Optimizing Post-hoc Stacking Ensemble Through Hyperparameter Tuning
par: Xu, Beicheng, et autres
Publié: (2025)

Rotary Masked Autoencoders are Versatile Learners
par: Zivanovic, Uros, et autres
Publié: (2025)

VRoPE: Rotary Position Embedding for Video Large Language Models
par: Liu, Zikang, et autres
Publié: (2025)

MF-QAT: Multi-Format Quantization-Aware Training for Elastic Inference
par: Xu, Zifei, et autres
Publié: (2026)

CoPE: A Lightweight Complex Positional Encoding
par: Amballa, Avinash
Publié: (2025)

CRoSS: A Continual Robotic Simulation Suite for Scalable Reinforcement Learning with High Task Diversity and Realistic Physics Simulation
par: Denker, Yannick, et autres
Publié: (2026)

The Impact of Quantization on Large Reasoning Model Reinforcement Learning
par: Kumar, Medha, et autres
Publié: (2025)

3-in-1: 2D Rotary Adaptation for Efficient Finetuning, Efficient Batching and Composability
par: Liao, Baohao, et autres
Publié: (2024)

Non-Parametric Rehearsal Learning via Conditional Mean Embeddings
par: Du, Wen-Bo, et autres
Publié: (2026)

FishRoPE: Projective Rotary Position Embeddings for Omnidirectional Visual Perception
par: Ahuja, Rahul, et autres
Publié: (2026)

VideoRoPE: What Makes for Good Video Rotary Position Embedding?
par: Wei, Xilin, et autres
Publié: (2025)

Rotary Offset Features in Large Language Models
par: Jonasson, André
Publié: (2025)

Understanding the Difficulty of Low-Precision Post-Training Quantization for LLMs
par: Xu, Zifei, et autres
Publié: (2024)

OpenBox: A Python Toolkit for Generalized Black-box Optimization
par: Jiang, Huaijun, et autres
Publié: (2023)

Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane
par: Liu, Haoyu, et autres
Publié: (2026)

CausalBench: A Comprehensive Benchmark for Causal Learning Capability of LLMs
par: Zhou, Yu, et autres
Publié: (2024)

SeqPE: Transformer with Sequential Position Encoding
par: Li, Huayang, et autres
Publié: (2025)

WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecasting
par: Liang, Aobo, et autres
Publié: (2024)

Rethinking the Role of Positional Encoding: Sliding-Window Transformers without PE Remain Turing Complete
par: Li, Qian, et autres
Publié: (2026)

Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization
par: Urrutia, Felipe, et autres
Publié: (2026)

Jordan-RoPE: Non-Semisimple Relative Positional Encoding via Complex Jordan Blocks
par: Zhang, Yaobo
Publié: (2026)

CRePE: Convolution-aware Relative Importance in Post-training Pruning with Efficient Search
par: Park, Cheonjun
Publié: (2026)

Machine Learning Framework for Thrombosis Risk Prediction in Rotary Blood Pumps
par: Blum, Christopher, et autres
Publié: (2025)