RetoVLA: Reusing Register Tokens for Spatial Reasoning in Vision-Language-Action Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917320223358976 |
|---|---|
| author | Koo, Jiyeon Cho, Taewan Kang, Hyunjoon Pyo, Eunseom Oh, Tae Gyun Kim, Taeryang Choi, Andrew Jaeyong |
| author_facet | Koo, Jiyeon Cho, Taewan Kang, Hyunjoon Pyo, Eunseom Oh, Tae Gyun Kim, Taeryang Choi, Andrew Jaeyong |
| contents | Vision-Language-Action (VLA) models have demonstrated robust performance across diverse robotic tasks. However, their high memory and computational demands often limit real-time deployment. While existing model compression techniques reduce the parameter footprint, they often drop in 3D spatial reasoning and scene layout understanding. This work introduces RetoVLA, an architecture designed to maintain spatial awareness in lightweight models by repurposing Register Tokens-learnable parameters originally introduced to mitigate attention artifacts in Vision Transformers. While these tokens are generally discarded once used, we repurpose them for their dense representation of global spatial context. RetoVLA integrates these recycled tokens directly into the action-planning module through a dedicated spatial context injection path. Our proposed design enables the recovery of global context without increasing the total parameter count. Real-world experiments using a 7-DOF manipulator show a 17.1%p improvement in average success rates over the baseline. Our results demonstrate that leveraging internal register tokens provides a highly effective mechanism for developing efficient, spatially-aware robotic agents. A video demonstration is available at: https://youtu.be/2CseBR-snZg |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_21243 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RetoVLA: Reusing Register Tokens for Spatial Reasoning in Vision-Language-Action Models Koo, Jiyeon Cho, Taewan Kang, Hyunjoon Pyo, Eunseom Oh, Tae Gyun Kim, Taeryang Choi, Andrew Jaeyong Robotics Vision-Language-Action (VLA) models have demonstrated robust performance across diverse robotic tasks. However, their high memory and computational demands often limit real-time deployment. While existing model compression techniques reduce the parameter footprint, they often drop in 3D spatial reasoning and scene layout understanding. This work introduces RetoVLA, an architecture designed to maintain spatial awareness in lightweight models by repurposing Register Tokens-learnable parameters originally introduced to mitigate attention artifacts in Vision Transformers. While these tokens are generally discarded once used, we repurpose them for their dense representation of global spatial context. RetoVLA integrates these recycled tokens directly into the action-planning module through a dedicated spatial context injection path. Our proposed design enables the recovery of global context without increasing the total parameter count. Real-world experiments using a 7-DOF manipulator show a 17.1%p improvement in average success rates over the baseline. Our results demonstrate that leveraging internal register tokens provides a highly effective mechanism for developing efficient, spatially-aware robotic agents. A video demonstration is available at: https://youtu.be/2CseBR-snZg |
| title | RetoVLA: Reusing Register Tokens for Spatial Reasoning in Vision-Language-Action Models |
| topic | Robotics |
| url | https://arxiv.org/abs/2509.21243 |