StateLinFormer: Stateful Training Enhancing Long-term Memory in Navigation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908911851798528 |
|---|---|
| author | Chen, Zhiyuan Zhong, Yuxuan Wang, Fan Yu, Bo Shao, Pengtao Liu, Shaoshan Ding, Ning |
| author_facet | Chen, Zhiyuan Zhong, Yuxuan Wang, Fan Yu, Bo Shao, Pengtao Liu, Shaoshan Ding, Ning |
| contents | Effective navigation intelligence relies on long-term memory to support both immediate generalization and sustained adaptation. However, existing approaches face a dilemma: modular systems rely on explicit mapping but lack flexibility, while Transformer-based end-to-end models are constrained by fixed context windows, limiting persistent memory across extended interactions. We introduce StateLinFormer, a linear-attention navigation model trained with a stateful memory mechanism that preserves recurrent memory states across consecutive training segments instead of reinitializing them at each batch boundary. This training paradigm effectively approximates learning on infinitely long sequences, enabling the model to achieve long-horizon memory retention. Experiments across both MAZE and ProcTHOR environments demonstrate that StateLinFormer significantly outperforms its stateless linear-attention counterpart and standard Transformer baselines with fixed context windows. Notably, as interaction length increases, persistent stateful training substantially improves context-dependent adaptation, suggesting an enhancement in the model's In-Context Learning (ICL) capabilities for navigation tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_23571 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | StateLinFormer: Stateful Training Enhancing Long-term Memory in Navigation Chen, Zhiyuan Zhong, Yuxuan Wang, Fan Yu, Bo Shao, Pengtao Liu, Shaoshan Ding, Ning Machine Learning Artificial Intelligence Effective navigation intelligence relies on long-term memory to support both immediate generalization and sustained adaptation. However, existing approaches face a dilemma: modular systems rely on explicit mapping but lack flexibility, while Transformer-based end-to-end models are constrained by fixed context windows, limiting persistent memory across extended interactions. We introduce StateLinFormer, a linear-attention navigation model trained with a stateful memory mechanism that preserves recurrent memory states across consecutive training segments instead of reinitializing them at each batch boundary. This training paradigm effectively approximates learning on infinitely long sequences, enabling the model to achieve long-horizon memory retention. Experiments across both MAZE and ProcTHOR environments demonstrate that StateLinFormer significantly outperforms its stateless linear-attention counterpart and standard Transformer baselines with fixed context windows. Notably, as interaction length increases, persistent stateful training substantially improves context-dependent adaptation, suggesting an enhancement in the model's In-Context Learning (ICL) capabilities for navigation tasks. |
| title | StateLinFormer: Stateful Training Enhancing Long-term Memory in Navigation |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2603.23571 |