Cover Image

Disentangling Direction and Magnitude in Transformer Representations: A Double Dissociation Through L2-Matched Perturbation Analysis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Vardhan, Mangadoddi Srikar, Teja, Lekkala Sai
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence Machine Learning I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Weber's Law in Transformer Magnitude Representations: Efficient Coding, Representational Geometry, and Psychophysical Laws in Language Models
by: Cacioli, Jon-Paul
Published: (2026)

Cognitive Load Limits in Large Language Models: Benchmarking Multi-Hop Reasoning
by: Adapala, Sai Teja Reddy
Published: (2025)

Fine-Grained Detection of AI-Generated Text Using Sentence-Level Segmentation
by: Teja, Lekkala Sai, et al.
Published: (2025)

PSK at SemEval-2026 Task 9: Multilingual Polarization Detection Using Ensemble Gemma Models with Synthetic Data Augmentation
by: Pulipaka, Srikar Kashyap
Published: (2026)

BitCal-TTS: Bit-Calibrated Test-Time Scaling for Quantized Reasoning Models
by: Patarlapalli, Sai Babu, et al.
Published: (2026)

Robustness of Large Language Models to Perturbations in Text
by: Singh, Ayush, et al.
Published: (2024)

Give it Space! Explicit Disentangling of Positional and Semantic Representations in Encoders
by: Lequeu, Pierre-Antoine, et al.
Published: (2026)

The Anti-Ouroboros Effect: Emergent Resilience in Large Language Models from Recursive Selective Feedback
by: Adapala, Sai Teja Reddy
Published: (2025)

Listen to the Layers: Mitigating Hallucinations with Inter-Layer Disagreement
by: Subbalakshmi, Koduvayur, et al.
Published: (2026)

Bidirectional RAG: Safe Self-Improving Retrieval-Augmented Generation Through Multi-Stage Validation
by: Chinthala, Teja
Published: (2025)

Whether, Not Which: Mechanistic Interpretability Reveals Dissociable Affect Reception and Emotion Categorization in LLMs
by: Keeman, Michael
Published: (2026)

Seeing Through the Fog: A Cost-Effectiveness Analysis of Hallucination Detection Systems
by: Thomas, Alexander, et al.
Published: (2024)

RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs
by: Saji, Alan, et al.
Published: (2025)

Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Review
by: Peters, Sydney, et al.
Published: (2025)

Enhancing Hate Speech Detection on Social Media: A Comparative Analysis of Machine Learning Models and Text Transformation Approaches
by: Mishra, Saurabh, et al.
Published: (2026)

The Dark Side of AI Transformers: Sentiment Polarization & the Loss of Business Neutrality by NLP Transformers
by: Kumar, Prasanna
Published: (2026)

Natural Language Processing for Tigrinya: Current State and Future Directions
by: Gaim, Fitsum, et al.
Published: (2025)

Exploring Graph Representations of Logical Forms for Language Modeling
by: Sullivan, Michael
Published: (2025)

Teaching Probabilistic Logical Reasoning to Transformers
by: Nafar, Aliakbar, et al.
Published: (2023)

Egalitarian Language Representation in Language Models: It All Begins with Tokenizers
by: Velayuthan, Menan, et al.
Published: (2024)

Direct Semantic Communication Between Large Language Models via Vector Translation
by: Yang, Fu-Chun, et al.
Published: (2025)

Mechanistic evaluation of Transformers and state space models
by: Arora, Aryaman, et al.
Published: (2025)

Exploring RWKV for Sentence Embeddings: Layer-wise Analysis and Baseline Comparison for Semantic Similarity
by: Pan, Xinghan
Published: (2025)

GNN-CNN: An Efficient Hybrid Model of Convolutional and Graph Neural Networks for Text Representation
by: Rastakhiz, Fardin
Published: (2025)

ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions
by: Shahin, Nada, et al.
Published: (2024)

A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models
by: Rai, Daking, et al.
Published: (2024)

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization
by: Nair, Sindhu, et al.
Published: (2024)

Transforming Dutch: Debiasing Dutch Coreference Resolution Systems for Non-binary Pronouns
by: van Boven, Goya, et al.
Published: (2024)

Low-Resource Court Judgment Summarization for Common Law Systems
by: Liu, Shuaiqi, et al.
Published: (2024)

Efficient Toxicity Detection in Gaming Chats: A Comparative Study of Embeddings, Fine-Tuned Transformers and LLMs
by: Tereshchenko, Yehor, et al.
Published: (2025)

Evaluating the Efficacy of Hybrid Deep Learning Models in Distinguishing AI-Generated Text
by: Oketunji, Abiodun Finbarrs
Published: (2023)

Weakly Supervised Distillation of Hallucination Signals into Transformer Representations
by: Salehmohamed, Shoaib Sadiq, et al.
Published: (2026)

StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis
by: Opara, Chidimma
Published: (2024)

Dynamic Domain Information Modulation Algorithm for Multi-domain Sentiment Analysis
by: Yue, Chunyi, et al.
Published: (2025)

ELECTRA and GPT-4o: Cost-Effective Partners for Sentiment Analysis
by: Beno, James P.
Published: (2024)

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification
by: Sirbu, Iustin, et al.
Published: (2025)

How Instruction-Tuning Imparts Length Control: A Cross-Lingual Mechanistic Analysis
by: Rocchetti, Elisabetta, et al.
Published: (2025)

Internal Reasoning vs. External Control: A Thermodynamic Analysis of Sycophancy in Large Language Models
by: Chang, Edward Y.
Published: (2025)

A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Features
by: Aityan, Sergey K., et al.
Published: (2025)

SD$^2$: Self-Distilled Sparse Drafters
by: Lasby, Mike, et al.
Published: (2025)