Cover Image

Transformers Can Navigate Mazes With Multi-Step Prediction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nolte, Niklas, Kitouni, Ouail, Williams, Adina, Rabbat, Mike, Ibrahim, Mark
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More
by: Kitouni, Ouail, et al.
Published: (2024)

From Neurons to Neutrons: A Case Study in Interpretability
by: Kitouni, Ouail, et al.
Published: (2024)

DiSK: A Diffusion Model for Structured Knowledge
by: Kitouni, Ouail, et al.
Published: (2023)

The Labyrinth of Links: Navigating the Associative Maze of Multi-modal LLMs
by: Li, Hong, et al.
Published: (2024)

What's in Common? Multimodal Models Hallucinate When Reasoning Across Scenes
by: Ross, Candace, et al.
Published: (2025)

Learning Distributions over Permutations and Rankings with Factorized Representations
by: Severo, Daniel, et al.
Published: (2025)

Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps
by: Zhao, Linfeng, et al.
Published: (2024)

Hierarchical Learning for Maze Navigation: Emergence of Mental Representations via Second-Order Learning
by: Manir, Shalima Binta, et al.
Published: (2025)

Navigating the Shortcut Maze: A Comprehensive Analysis of Shortcut Learning in Text Classification by Language Models
by: Zhou, Yuqing, et al.
Published: (2024)

Transformers Use Causal World Models in Maze-Solving Tasks
by: Spies, Alex F., et al.
Published: (2024)

Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density
by: Balestriero, Randall, et al.
Published: (2025)

On Logical Extrapolation for Mazes with Recurrent and Implicit Networks
by: Knutson, Brandon, et al.
Published: (2024)

A Retrieval-Enhanced Transformer for Multi-Step Port-of-Call Sequence Prediction in Global Liner Shipping
by: Su, Yanzhao, et al.
Published: (2026)

Semantic Step Prediction: Multi-Step Latent Forecasting in LLM Reasoning Trajectories via Step Sampling
by: Yuan, Yidi
Published: (2026)

Can we Improve Prediction of Psychotherapy Outcomes Through Pretraining With Simulated Data?
by: Jacobs, Niklas, et al.
Published: (2026)

What Makes a Maze Look Like a Maze?
by: Hsu, Joy, et al.
Published: (2024)

Modeling Multi-Step Scientific Processes with Graph Transformer Networks
by: Volk, Amanda A., et al.
Published: (2024)

Can Transformers Predict Vibrations?
by: Kuniyoshi, Fusataka, et al.
Published: (2024)

Towards Generalized Hydrological Forecasting using Transformer Models for 120-Hour Streamflow Prediction
by: Demiray, Bekir Z., et al.
Published: (2024)

Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmasking
by: Ben-Hamu, Heli, et al.
Published: (2025)

Efficient Normalized Conformal Prediction and Uncertainty Quantification for Anti-Cancer Drug Sensitivity Prediction with Deep Regression Forests
by: Nolte, Daniel, et al.
Published: (2024)

Eval Factsheets: A Structured Framework for Documenting AI Evaluations
by: Bordes, Florian, et al.
Published: (2025)

Safe Multi-Agent Navigation guided by Goal-Conditioned Safe Reinforcement Learning
by: Feng, Meng, et al.
Published: (2025)

Scalable Option Learning in High-Throughput Environments
by: Henaff, Mikael, et al.
Published: (2025)

Can Optimization Trajectories Explain Multi-Task Transfer?
by: Mueller, David, et al.
Published: (2024)

Synthesizability Prediction of Crystalline Structures with a Hierarchical Transformer and Uncertainty Quantification
by: Ebrahimzadeh, Danial, et al.
Published: (2025)

MazeNet: An Accurate, Fast, and Scalable Deep Learning Solution for Steiner Minimum Trees
by: Ramos, Gabriel Díaz, et al.
Published: (2024)

Compositional learning of functions in humans and machines
by: Zhou, Yanli, et al.
Published: (2024)

EDformer: Embedded Decomposition Transformer for Interpretable Multivariate Time Series Predictions
by: Chakraborty, Sanjay, et al.
Published: (2024)

Plain Transformers Can be Powerful Graph Learners
by: Ma, Liheng, et al.
Published: (2025)

Using ARIMA to Predict the Expansion of Subscriber Data Consumption
by: Nkongolo, Mike Wa
Published: (2024)

Multi-Step Traffic Prediction for Multi-Period Planning in Optical Networks
by: Maryam, Hafsa, et al.
Published: (2024)

A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task
by: Brinkmann, Jannik, et al.
Published: (2024)

Do different prompting methods yield a common task representation in language models?
by: Davidson, Guy, et al.
Published: (2025)

Superlinear Multi-Step Attention
by: Huang, Yufeng
Published: (2026)

Incorporating Navigation Context into Inland Vessel Trajectory Prediction: A Gaussian Mixture Model and Transformer Approach
by: Donandt, Kathrin, et al.
Published: (2024)

Parallel Stochastic Gradient-Based Planning for World Models
by: Psenka, Michael, et al.
Published: (2026)

Multi-Agent Inverted Transformer for Flight Trajectory Prediction
by: Yoon, Seokbin, et al.
Published: (2025)

DP-RDM: Adapting Diffusion Models to Private Domains Without Fine-Tuning
by: Lebensold, Jonathan, et al.
Published: (2024)

Distributed Sign Momentum with Local Steps for Training Transformers
by: Yu, Shuhua, et al.
Published: (2024)