Cover Image

Relational Rank Geometry in Transformers: Detecting and Steering Hidden-State Relation Frames

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Kobrosly, Mazen
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Token Hidden Reward: Steering Exploration-Exploitation in Group Relative Deep Reinforcement Learning
by: Deng, Wenlong, et al.
Published: (2025)

Steer-to-Detect: Probing Hidden Representations for Detection of LLM-Generated Texts
by: Liang, Luxu, et al.
Published: (2026)

When Is Rank-1 Steering Cheap? Geometry, Granularity, and Budgeted Search
by: Robertson, John T., et al.
Published: (2026)

On the Relation of State Space Models and Hidden Markov Models
by: Ghojogh, Aydin, et al.
Published: (2026)

Variable Selection Using Relative Importance Rankings
by: Chang, Tien-En, et al.
Published: (2025)

FishBack: Pullback Fisher Geometry for Optimal Activation Steering in Transformers
by: Wang, Sihan, et al.
Published: (2026)

Relational Preference Encoding in Looped Transformer Internal States
by: Kirin, Jan
Published: (2026)

Discovering Hidden Algebraic Structures via Transformers with Rank-Aware Beam GRPO
by: Lee, Jaeha, et al.
Published: (2025)

Connecting Neural Models Latent Geometries with Relative Geodesic Representations
by: Yu, Hanlin, et al.
Published: (2025)

Gaussian Relational Graph Transformer
by: Ding, Zezhong, et al.
Published: (2026)

On the Expressive Power of Contextual Relations in Transformers
by: Fraiman, Demián
Published: (2026)

On the Role of Hidden States of Modern Hopfield Network in Transformer
by: Masumura, Tsubasa, et al.
Published: (2025)

Relational Graph Transformer
by: Dwivedi, Vijay Prakash, et al.
Published: (2025)

Relative Geometry of Neural Forecasters: Linking Accuracy and Alignment in Learned Latent Geometry
by: Kucukahmetler, Deniz, et al.
Published: (2026)

Geometry- and Relation-Aware Diffusion for EEG Super-Resolution
by: Yao, Laura, et al.
Published: (2026)

Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden States
by: Miao, Miranda Muqing, et al.
Published: (2026)

Relating CNN-Transformer Fusion Network for Change Detection
by: Gao, Yuhao, et al.
Published: (2024)

The Information Geometry of Softmax: Probing and Steering
by: Park, Kiho, et al.
Published: (2026)

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
by: Choromanski, Krzysztof Marcin, et al.
Published: (2023)

Manifold Steering Reveals the Shared Geometry of Neural Network Representation and Behavior
by: Wurgaft, Daniel, et al.
Published: (2026)

Disentangling and Integrating Relational and Sensory Information in Transformer Architectures
by: Altabaa, Awni, et al.
Published: (2024)

Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data
by: Ranjan, Rishabh, et al.
Published: (2025)

F-GRPO: Factorized Group-Relative Policy Optimization for Unified Candidate Generation and Ranking
by: Surana, Rohan, et al.
Published: (2026)

From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs
by: Schiekiera, Louis, et al.
Published: (2026)

Low Rank Transformer for Multivariate Time Series Anomaly Detection and Localization
by: Shimillas, Charalampos, et al.
Published: (2026)

Spherical Steering: Geometry-Aware Activation Rotation for Language Models
by: You, Zejia, et al.
Published: (2026)

Graph State-Space Models and Latent Relational Inference
by: Zambon, Daniele, et al.
Published: (2023)

Functional Interpolation for Relative Positions Improves Long Context Transformers
by: Li, Shanda, et al.
Published: (2023)

Hidden or Inferred: Fair Learning-To-Rank with Unknown Demographics
by: Olulana, Oluseun, et al.
Published: (2024)

The Logical Implication Steering Method for Conditional Interventions on Transformer Generation
by: Kalajdzievski, Damjan
Published: (2025)

Efficient Algorithms for Verifying Kruskal Rank in Sparse Linear Regression and Related Applications
by: Zhou, Fengqin
Published: (2025)

MART: MultiscAle Relational Transformer Networks for Multi-agent Trajectory Prediction
by: Lee, Seongju, et al.
Published: (2024)

Spatially Constrained Transformer with Efficient Global Relation Modelling for Spatio-Temporal Prediction
by: Sao, Ashutosh, et al.
Published: (2024)

Learning Hierarchical Relational Representations through Relational Convolutions
by: Altabaa, Awni, et al.
Published: (2023)

Estimating the Effective Rank of Vision Transformers via Low-Rank Factorization
by: Zerihun, Liyu
Published: (2025)

Attention Down-Sampling Transformer, Relative Ranking and Self-Consistency for Blind Image Quality Assessment
by: Alsaafin, Mohammed, et al.
Published: (2024)

OrthoFormer: Instrumental Variable Estimation in Transformer Hidden States via Neural Control Functions
by: Luo, Charles
Published: (2026)

Relational Feature Caching for Accelerating Diffusion Transformers
by: Son, Byunggwan, et al.
Published: (2026)

Dynamic Relational Priming Improves Transformer in Multivariate Time Series
by: Lee, Hunjae, et al.
Published: (2025)

Representation Learning on Hyper-Relational and Numeric Knowledge Graphs with Transformers
by: Chung, Chanyoung, et al.
Published: (2023)