Cover Image

Give it Space! Explicit Disentangling of Positional and Semantic Representations in Encoders

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lequeu, Pierre-Antoine, Barboule, Camille, Piwowarski, Benjamin
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence 68T50 I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models
by: Miliani, Martina, et al.
Published: (2025)

Prompting Encoder Models for Zero-Shot Classification: A Cross-Domain Study in Italian
by: Auriemma, Serena, et al.
Published: (2024)

LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations
by: Orgad, Hadas, et al.
Published: (2024)

Semantic Synergy: Unlocking Policy Insights and Learning Pathways Through Advanced Skill Mapping
by: Koundouri, Phoebe, et al.
Published: (2025)

Topeax -- An Improved Clustering Topic Model with Density Peak Detection and Lexical-Semantic Term Importance
by: Kardos, Márton
Published: (2026)

ADE: Adaptive Dictionary Embeddings -- Scaling Multi-Anchor Representations to Large Language Models
by: Demirci, Orhan, et al.
Published: (2026)

$\text{Memory}^3$: Language Modeling with Explicit Memory
by: Yang, Hongkang, et al.
Published: (2024)

Towards Ontology-Enhanced Representation Learning for Large Language Models
by: Ronzano, Francesco, et al.
Published: (2024)

DYNAMICQA: Tracing Internal Knowledge Conflicts in Language Models
by: Marjanović, Sara Vera, et al.
Published: (2024)

Cognitive Workspace: Active Memory Management for LLMs -- An Empirical Study of Functional Infinite Context
by: An, Tao
Published: (2025)

One Agent to Serve All: a Lite-Adaptive Stylized AI Assistant for Millions of Multi-Style Official Accounts
by: Fan, Xingyu, et al.
Published: (2025)

The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMs
by: Fang, Xi, et al.
Published: (2025)

TREX: Tokenizer Regression for Optimal Data Mixture
by: Won, Inho, et al.
Published: (2026)

Language corpora for the Dutch medical domain
by: van Es, B.
Published: (2026)

MemeLens: Multilingual Multitask VLMs for Memes
by: Shahroor, Ali Ezzat, et al.
Published: (2026)

Rapid Biomedical Research Classification: The Pandemic PACT Advanced Categorisation Engine
by: Rohanian, Omid, et al.
Published: (2024)

Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation
by: Xu, Zhe, et al.
Published: (2024)

Understanding the Effects of RLHF on the Quality and Detectability of LLM-Generated Texts
by: Xu, Beining, et al.
Published: (2025)

Tokenization Is More Than Compression
by: Schmidt, Craig W., et al.
Published: (2024)

A Graph-based Approach for Multi-Modal Question Answering from Flowcharts in Telecom Documents
by: Soman, Sumit, et al.
Published: (2025)

Revealing the Parametric Knowledge of Language Models: A Unified Framework for Attribution Methods
by: Yu, Haeun, et al.
Published: (2024)

SpokenNativQA: Multilingual Everyday Spoken Queries for LLMs
by: Alam, Firoj, et al.
Published: (2025)

Boundless Byte Pair Encoding: Breaking the Pre-tokenization Barrier
by: Schmidt, Craig W., et al.
Published: (2025)

Obfuscation Rules for Detecting and Detoxifying Korean Toxicity
by: Lee, Yejin, et al.
Published: (2025)

LayerTracer: A Joint Task-Particle and Vulnerable-Layer Analysis framework for Arbitrary Large Language Model Architectures
by: Wu, Yuhang, et al.
Published: (2026)

CATER: Leveraging LLM to Pioneer a Multidimensional, Reference-Independent Paradigm in Translation Quality Evaluation
by: IIDA, Kurando, et al.
Published: (2024)

Isolating LLM Lexical Bias: A Curation-Free Triangulated Metric for Preference-Stage Learning
by: Ming, Xiaoyang, et al.
Published: (2026)

A Comprehensive Survey of Compression Algorithms for Language Models
by: Park, Seungcheol, et al.
Published: (2024)

Arithmetic in the Wild: Llama uses Base-10 Addition to Reason About Cyclic Concepts
by: Feucht, Sheridan, et al.
Published: (2026)

ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses
by: Zong, Chang, et al.
Published: (2024)

RV-HATE: Reinforced Multi-Module Voting for Implicit Hate Speech Detection
by: Lee, Yejin, et al.
Published: (2025)

Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL
by: Tu, Songjun, et al.
Published: (2025)

Task Complexity Matters: An Empirical Study of Reasoning in LLMs for Sentiment Analysis
by: Huang, Donghao, et al.
Published: (2026)

Efficient Adaptive Rejection Sampling for Accelerating Speculative Decoding in Large Language Models
by: Sun, Chendong, et al.
Published: (2025)

Reducing Hallucinations in Summarization via Reinforcement Learning with Entity Hallucination Index
by: Katwe, Praveenkumar, et al.
Published: (2025)

S2vNTM: Semi-supervised vMF Neural Topic Modeling
by: Xu, Weijie, et al.
Published: (2023)

Structured Sentiment Analysis as Transition-based Dependency Graph Parsing
by: Fernández-González, Daniel
Published: (2023)

Bielik 11B v2 Technical Report
by: Ociepa, Krzysztof, et al.
Published: (2025)

MORABLES: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables
by: Marcuzzo, Matteo, et al.
Published: (2025)

Pun Unintended: LLMs and the Illusion of Humor Understanding
by: Zangari, Alessandro, et al.
Published: (2025)