Image de couverture de livre

MapFormer: Self-Supervised Learning of Cognitive Maps with Input-Dependent Positional Embeddings

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Rambaud, Victor, Mascarenhas, Salvador, Lakretz, Yair
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Meta-Learning Neural Mechanisms rather than Bayesian Priors
par: Goodale, Michael, et autres
Publié: (2025)

Optimizing fMRI Data Acquisition for Decoding Natural Speech with Limited Participants
par: Jalouzot, Louis, et autres
Publié: (2025)

RobustSentEmbed: Robust Sentence Embeddings Using Adversarial Self-Supervised Contrastive Learning
par: Asl, Javad Rafiei, et autres
Publié: (2024)

Prediction is not Explanation: Revisiting the Explanatory Capacity of Mapping Embeddings
par: Herasimchyk, Hanna, et autres
Publié: (2025)

Selective Rotary Position Embedding
par: Movahedi, Sajad, et autres
Publié: (2025)

Token Distillation: Attention-aware Input Embeddings For New Tokens
par: Dobler, Konstantin, et autres
Publié: (2025)

Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization
par: Huang, Wei-Ping, et autres
Publié: (2024)

Factor Augmented Supervised Learning with Text Embeddings
par: Luo, Zhanye, et autres
Publié: (2025)

An Aspect Extraction Framework using Different Embedding Types, Learning Models, and Dependency Structure
par: Erkan, Ali, et autres
Publié: (2025)

Self-Adaptive Reconstruction with Contrastive Learning for Unsupervised Sentence Embeddings
par: Liu, Junlong, et autres
Publié: (2024)

Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations
par: Jalouzot, Louis, et autres
Publié: (2024)

Geometric Organization of Cognitive States in Transformer Embedding Spaces
par: Zhao, Sophie
Publié: (2025)

Mapping Faithful Reasoning in Language Models
par: Li, Jiazheng, et autres
Publié: (2025)

Unsupervised Location Mapping for Narrative Corpora
par: Wagner, Eitan, et autres
Publié: (2025)

DMAP: A Distribution Map for Text
par: Kempton, Tom, et autres
Publié: (2026)

Mapping Transformer Leveraged Embeddings for Cross-Lingual Document Representation
par: Tashu, Tsegaye Misikir, et autres
Publié: (2024)

Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
par: Zuo, Chunsheng, et autres
Publié: (2024)

Matryoshka-Adaptor: Unsupervised and Supervised Tuning for Smaller Embedding Dimensions
par: Yoon, Jinsung, et autres
Publié: (2024)

RecurFormer: Not All Transformer Heads Need Self-Attention
par: Yan, Ruiqing, et autres
Publié: (2024)

Reconsidering Positional Supervision in Masked Diffusion Language Model Training
par: Ye, Mengyu, et autres
Publié: (2026)

Self-Supervised Learning for Neural Topic Models with Variance-Invariance-Covariance Regularization
par: Xu, Weiran, et autres
Publié: (2025)

Self-Harmony: Learning to Harmonize Self-Supervision and Self-Play in Test-Time Reinforcement Learning
par: Wang, Ru, et autres
Publié: (2025)

Self-Supervised Multimodal Learning: A Survey
par: Zong, Yongshuo, et autres
Publié: (2023)

Self-Supervised Position Debiasing for Large Language Models
par: Liu, Zhongkun, et autres
Publié: (2024)

Information Structure in Mappings: An Approach to Learning, Representation, and Generalisation
par: Conklin, Henry
Publié: (2025)

Position as Probability: Self-Supervised Transformers that Think Past Their Training for Length Extrapolation
par: Lee, Philip Heejun
Publié: (2025)

Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media
par: Qi, Hongzhi, et autres
Publié: (2023)

Self-Supervised Detection of Perfect and Partial Input-Dependent Symmetries
par: Urbano, Alonso, et autres
Publié: (2023)

Enhancing Sindhi Word Segmentation using Subword Representation Learning and Position-aware Self-attention
par: Ali, Wazir, et autres
Publié: (2020)

From Style to Facts: Mapping the Boundaries of Knowledge Injection with Finetuning
par: Zhao, Eric, et autres
Publié: (2025)

Mapping from Meaning: Addressing the Miscalibration of Prompt-Sensitive Language Models
par: Cox, Kyle, et autres
Publié: (2025)

Evaluating the Performance of Large Language Models for SDG Mapping (Technical Report)
par: Yin, Hui, et autres
Publié: (2024)

Heterogeneous Self-Supervised Acoustic Pre-Training with Local Constraints
par: Cui, Xiaodong, et autres
Publié: (2025)

Deep Augmentation: Dropout as Augmentation for Self-Supervised Learning
par: Brüel-Gabrielsson, Rickard, et autres
Publié: (2023)

The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval
par: Chiang, Ting-Rui, et autres
Publié: (2025)

Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation
par: Wang, Yu, et autres
Publié: (2025)

IAM: Efficient Inference through Attention Mapping between Different-scale LLMs
par: Zhao, Yi, et autres
Publié: (2025)

Minimally Supervised Learning using Topological Projections in Self-Organizing Maps
par: Lyu, Zimeng, et autres
Publié: (2024)

Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings
par: Gopalakrishnan, Anand, et autres
Publié: (2025)

External Hippocampus: Topological Cognitive Maps for Guiding Large Language Model Reasoning
par: Yan, Jian
Publié: (2025)