STRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908934733824000 |
|---|---|
| author | Ren, Hao Bi, Zetong Zeng, Yiming Wan, Zhaoliang Qi, Lu Cheng, Hui |
| author_facet | Ren, Hao Bi, Zetong Zeng, Yiming Wan, Zhaoliang Qi, Lu Cheng, Hui |
| contents | Visual navigation requires the robot to reach a specified goal such as an image, based on a sequence of first-person visual observations. While recent learning-based approaches have made significant progress, they often focus on improving policy heads or decision strategies while relying on simplistic feature encoders and temporal pooling to represent visual input. This leads to the loss of fine-grained spatial and temporal structure, ultimately limiting accurate action prediction and progress estimation. In this paper, we propose a unified spatio-temporal representation framework that enhances visual encoding for robotic navigation. Our approach extracts features from both image sequences and goal observations, and fuses them using the designed spatio-temporal fusion module. This module performs spatial graph reasoning within each frame and models temporal dynamics using a hybrid temporal shift module combined with multi-resolution difference-aware convolution. Experimental results demonstrate that our approach consistently improves navigation performance and offers a generalizable visual backbone for goal-conditioned control. Code is available at \href{https://github.com/hren20/STRNet}{https://github.com/hren20/STRNet}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_02829 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | STRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation Ren, Hao Bi, Zetong Zeng, Yiming Wan, Zhaoliang Qi, Lu Cheng, Hui Computer Vision and Pattern Recognition Robotics Visual navigation requires the robot to reach a specified goal such as an image, based on a sequence of first-person visual observations. While recent learning-based approaches have made significant progress, they often focus on improving policy heads or decision strategies while relying on simplistic feature encoders and temporal pooling to represent visual input. This leads to the loss of fine-grained spatial and temporal structure, ultimately limiting accurate action prediction and progress estimation. In this paper, we propose a unified spatio-temporal representation framework that enhances visual encoding for robotic navigation. Our approach extracts features from both image sequences and goal observations, and fuses them using the designed spatio-temporal fusion module. This module performs spatial graph reasoning within each frame and models temporal dynamics using a hybrid temporal shift module combined with multi-resolution difference-aware convolution. Experimental results demonstrate that our approach consistently improves navigation performance and offers a generalizable visual backbone for goal-conditioned control. Code is available at \href{https://github.com/hren20/STRNet}{https://github.com/hren20/STRNet}. |
| title | STRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2604.02829 |