Copertina

Learning to Rotate: Temporal and Semantic Rotary Encoding for Sequential Modeling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Cheng, Hailing, Sun, Daqi, Lu, Xinyu
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Rotary Position Encodings for Graphs
di: Reid, Isaac, et al.
Pubblicazione: (2025)

Beyond Interleaving: Causal Attention Reformulations for Generative Recommender Systems
di: Cheng, Hailing
Pubblicazione: (2026)

SPECTRE: Spectral Pre-training Embeddings with Cylindrical Temporal Rotary Position Encoding for Fine-Grained sEMG-Based Movement Decoding
di: Weng, Zihan, et al.
Pubblicazione: (2025)

HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models
di: Dai, Chang, et al.
Pubblicazione: (2025)

Adaptive 3D-RoPE: Physics-Aligned Rotary Positional Encoding for Wireless Foundation Models
di: Zhang, Chenyu, et al.
Pubblicazione: (2026)

SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence
di: Jin, Hailing, et al.
Pubblicazione: (2026)

Scalable Hyperparameter-Divergent Ensemble Training with Automatic Learning Rate Exploration for Large Models
di: Cheng, Hailing, et al.
Pubblicazione: (2026)

Lightweight Spatio-Temporal Attention Network with Graph Embedding and Rotational Position Encoding for Traffic Forecasting
di: Wang, Xiao, et al.
Pubblicazione: (2025)

C^2ROPE: Causal Continuous Rotary Positional Encoding for 3D Large Multimodal-Models Reasoning
di: Ye, Guanting, et al.
Pubblicazione: (2026)

LSRE: Latent Semantic Rule Encoding for Real-Time Semantic Risk Detection in Autonomous Driving
di: Cheng, Qian, et al.
Pubblicazione: (2025)

VRoPE: Rotary Position Embedding for Video Large Language Models
di: Liu, Zikang, et al.
Pubblicazione: (2025)

Representation Potentials of Foundation Models for Multimodal Alignment: A Survey
di: Lu, Jianglin, et al.
Pubblicazione: (2025)

Language Models as Semantic Augmenters for Sequential Recommenders
di: Valizadeh, Mahsa, et al.
Pubblicazione: (2025)

Semantic-Enhanced Representation Learning for Road Networks with Temporal Dynamics
di: Chen, Yile, et al.
Pubblicazione: (2024)

Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation
di: Cui, Ziqiang, et al.
Pubblicazione: (2025)

Modeling Temporal Positive and Negative Excitation for Sequential Recommendation
di: Huang, Chengkai, et al.
Pubblicazione: (2024)

Learning-based Motion Planning in Dynamic Environments Using GNNs and Temporal Encoding
di: Zhang, Ruipeng, et al.
Pubblicazione: (2022)

Sequential Recommendation on Temporal Proximities with Contrastive Learning and Self-Attention
di: Jung, Hansol, et al.
Pubblicazione: (2024)

Trajectory Encoding Temporal Graph Networks
di: Xiong, Jiafeng, et al.
Pubblicazione: (2025)

SeqPE: Transformer with Sequential Position Encoding
di: Li, Huayang, et al.
Pubblicazione: (2025)

Locality Sensitive Sparse Encoding for Learning World Models Online
di: Liu, Zichen, et al.
Pubblicazione: (2024)

EVA02-AT: Egocentric Video-Language Understanding with Spatial-Temporal Rotary Positional Embeddings and Symmetric Optimization
di: Wang, Xiaoqi, et al.
Pubblicazione: (2025)

Few-shot Semantic Encoding and Decoding for Video Surveillance
di: Cheng, Baoping, et al.
Pubblicazione: (2025)

Knowledge-Enhanced Conversational Recommendation via Transformer-based Sequential Modelling
di: Zou, Jie, et al.
Pubblicazione: (2024)

SrSv: Integrating Sequential Rollouts with Sequential Value Estimation for Multi-agent Reinforcement Learning
di: Wan, Xu, et al.
Pubblicazione: (2025)

Temporal-IRL: Modeling Port Congestion and Berth Scheduling with Inverse Reinforcement Learning
di: Li, Guo, et al.
Pubblicazione: (2025)

Enhancing Building Semantics Preservation in AI Model Training with Large Language Model Encodings
di: Jang, Suhyung, et al.
Pubblicazione: (2026)

TGB-Seq Benchmark: Challenging Temporal GNNs with Complex Sequential Dynamics
di: Yi, Lu, et al.
Pubblicazione: (2025)

MHA-RAG: Improving Efficiency, Accuracy, and Consistency by Encoding Exemplars as Soft Prompts
di: Jain, Abhinav, et al.
Pubblicazione: (2025)

Learning Local and Global Temporal Contexts for Video Semantic Segmentation
di: Sun, Guolei, et al.
Pubblicazione: (2022)

DeepDFA: Injecting Temporal Logic in Deep Learning for Sequential Subsymbolic Applications
di: Umili, Elena, et al.
Pubblicazione: (2026)

DELRec: Distilling Sequential Pattern to Enhance LLMs-based Sequential Recommendation
di: Zhang, Haoyi, et al.
Pubblicazione: (2024)

Linear Attention is Enough in Spatial-Temporal Forecasting
di: Ning, Xinyu
Pubblicazione: (2024)

Isotonic Layer: A Unified Framework for Recommendation Calibration and Debiasing
di: Cheng, Hailing, et al.
Pubblicazione: (2026)

Understanding and Improving Laplacian Positional Encodings For Temporal GNNs
di: Galron, Yaniv, et al.
Pubblicazione: (2025)

Learnable Spatial-Temporal Positional Encoding for Link Prediction
di: Tieu, Katherine, et al.
Pubblicazione: (2025)

DCL-SE: Dynamic Curriculum Learning for Spatiotemporal Encoding of Brain Imaging
di: Zhou, Meihua, et al.
Pubblicazione: (2025)

Quantifying Semantic Emergence in Language Models
di: Chen, Hang, et al.
Pubblicazione: (2024)

PAS: A Training-Free Stabilizer for Temporal Encoding in Video LLMs
di: Sun, Bowen, et al.
Pubblicazione: (2025)

SkillGen: Learning Domain Skills for In-Context Sequential Decision Making
di: Ding, Ruomeng, et al.
Pubblicazione: (2025)