Cover Image

Context-aware Rotary Position Embedding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Veisi, Ali, Fartoot, Delaram, Amirzadeh, Hamidreza
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Context-aware Biases for Length Extrapolation
by: Veisi, Ali, et al.
Published: (2025)

Selective Rotary Position Embedding
by: Movahedi, Sajad, et al.
Published: (2025)

How Language Models Prioritize Contextual Grammatical Cues?
by: Amirzadeh, Hamidreza, et al.
Published: (2024)

Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs
by: Liu, Xiaoran, et al.
Published: (2025)

DoPE: Denoising Rotary Position Embedding
by: Xiong, Jing, et al.
Published: (2025)

KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding
by: Shi, Luohe, et al.
Published: (2025)

MrRoPE: Mixed-radix Rotary Position Embedding
by: Tian, Qingyuan, et al.
Published: (2026)

data2lang2vec: Data Driven Typological Features Completion
by: Amirzadeh, Hamidreza, et al.
Published: (2024)

Benchmarking Rotary Position Embeddings for Automatic Speech Recognition
by: Zhang, Shucong, et al.
Published: (2025)

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
by: Liu, Feilong
Published: (2026)

Length-Aware Rotary Position Embedding for Text-Speech Alignment
by: Kim, Hyeongju, et al.
Published: (2025)

3D-RPE: Enhancing Long-Context Modeling Through 3D Rotary Position Encoding
by: Ma, Xindian, et al.
Published: (2024)

TransXSSM: A Hybrid Transformer State Space Model with Unified Rotary Position Embedding
by: Wu, Bingheng, et al.
Published: (2025)

The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval
by: Chiang, Ting-Rui, et al.
Published: (2025)

A$^2$ATS: Retrieval-Based KV Cache Reduction via Windowed Rotary Position Embedding and Query-Aware Vector Quantization
by: He, Junhui, et al.
Published: (2025)

Task-agnostic Prompt Compression with Context-aware Sentence Embedding and Reward-guided Task Descriptor
by: Liskavets, Barys, et al.
Published: (2025)

Towards Domain Specification of Embedding Models in Medicine
by: Khodadad, Mohammad, et al.
Published: (2025)

Gammatonegram Representation for End-to-End Dysarthric Speech Processing Tasks: Speech Recognition, Speaker Identification, and Intelligibility Assessment
by: Farhadipour, Aref, et al.
Published: (2023)

Bayesian Network Fusion of Large Language Models for Sentiment Analysis
by: Amirzadeh, Rasoul, et al.
Published: (2025)

Round and Round We Go! What makes Rotary Positional Encodings useful?
by: Barbero, Federico, et al.
Published: (2024)

Extending the Context of Pretrained LLMs by Dropping Their Positional Embeddings
by: Gelberg, Yoav, et al.
Published: (2025)

The Role of Orthographic Consistency in Multilingual Embedding Models for Text Classification in Arabic-Script Languages
by: Abdullah, Abdulhady Abas, et al.
Published: (2025)

Rotary Position Embedding for Vision Transformer
by: Heo, Byeongho, et al.
Published: (2024)

ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain
by: Kasmaee, Ali Shiraee, et al.
Published: (2024)

KurdSTS: The Kurdish Semantic Textual Similarity
by: Abdullah, Abdulhady Abas, et al.
Published: (2025)

KuBERT: Central Kurdish BERT Model and Its Application for Sentiment Analysis
by: Awlla, Kozhin muhealddin, et al.
Published: (2025)

ChEmbed: Enhancing Chemical Literature Search Through Domain-Specific Text Embeddings
by: Kasmaee, Ali Shiraee, et al.
Published: (2025)

HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models
by: Dai, Chang, et al.
Published: (2025)

Revisiting Context Choices for Context-aware Machine Translation
by: Rikters, Matīss, et al.
Published: (2021)

Efficient Matrix Implementation for Rotary Position Embedding
by: Minqi, Chen, et al.
Published: (2026)

Counting-Stars: A Multi-evidence, Position-aware, and Scalable Benchmark for Evaluating Long-Context Large Language Models
by: Song, Mingyang, et al.
Published: (2024)

Rotary Offset Features in Large Language Models
by: Jonasson, André
Published: (2025)

Context-aware Prompt Tuning: Advancing In-Context Learning with Adversarial Methods
by: Blau, Tsachi, et al.
Published: (2024)

Enhancing Kurdish Text-to-Speech with Native Corpus Training: A High-Quality WaveGlow Vocoder Approach
by: Abdullah, Abdulhady Abas, et al.
Published: (2024)

Neural Isomorphic Fields: A Transformer-based Algebraic Numerical Embedding
by: Sadeghi, Hamidreza, et al.
Published: (2026)

Embedding-Based Context-Aware Reranker
by: Yuan, Ye, et al.
Published: (2025)

RomanTex: Decoupling 3D-aware Rotary Positional Embedded Multi-Attention Network for Texture Synthesis
by: Feng, Yifei, et al.
Published: (2025)

The Impact of Role Design in In-Context Learning for Large Language Models
by: Rouzegar, Hamidreza, et al.
Published: (2025)

A Context-aware Framework for Translation-mediated Conversations
by: Pombal, José, et al.
Published: (2024)

On Context-aware Detection of Cherry-picking in News Reporting
by: Jaradat, Israa, et al.
Published: (2024)