FASTer: Focal Token Acquiring-and-Scaling Transformer for Long-term 3D Object Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dang, Chenxu, Duan, Zaipeng, An, Pei, Zhang, Xinmin, Hu, Xuzhong, Ma, Jie
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915181223739392
author Dang, Chenxu
Duan, Zaipeng
An, Pei
Zhang, Xinmin
Hu, Xuzhong
Ma, Jie
author_facet Dang, Chenxu
Duan, Zaipeng
An, Pei
Zhang, Xinmin
Hu, Xuzhong
Ma, Jie
contents Recent top-performing temporal 3D detectors based on Lidars have increasingly adopted region-based paradigms. They first generate coarse proposals, followed by encoding and fusing regional features. However, indiscriminate sampling and fusion often overlook the varying contributions of individual points and lead to exponentially increased complexity as the number of input frames grows. Moreover, arbitrary result-level concatenation limits the global information extraction. In this paper, we propose a Focal Token Acquring-and-Scaling Transformer (FASTer), which dynamically selects focal tokens and condenses token sequences in an adaptive and lightweight manner. Emphasizing the contribution of individual tokens, we propose a simple but effective Adaptive Scaling mechanism to capture geometric contexts while sifting out focal points. Adaptively storing and processing only focal points in historical frames dramatically reduces the overall complexity. Furthermore, a novel Grouped Hierarchical Fusion strategy is proposed, progressively performing sequence scaling and Intra-Group Fusion operations to facilitate the exchange of global spatial and temporal information. Experiments on the Waymo Open Dataset demonstrate that our FASTer significantly outperforms other state-of-the-art detectors in both performance and efficiency while also exhibiting improved flexibility and robustness. The code is available at https://github.com/MSunDYY/FASTer.git.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01899
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FASTer: Focal Token Acquiring-and-Scaling Transformer for Long-term 3D Object Detection
Dang, Chenxu
Duan, Zaipeng
An, Pei
Zhang, Xinmin
Hu, Xuzhong
Ma, Jie
Computer Vision and Pattern Recognition
Artificial Intelligence
Recent top-performing temporal 3D detectors based on Lidars have increasingly adopted region-based paradigms. They first generate coarse proposals, followed by encoding and fusing regional features. However, indiscriminate sampling and fusion often overlook the varying contributions of individual points and lead to exponentially increased complexity as the number of input frames grows. Moreover, arbitrary result-level concatenation limits the global information extraction. In this paper, we propose a Focal Token Acquring-and-Scaling Transformer (FASTer), which dynamically selects focal tokens and condenses token sequences in an adaptive and lightweight manner. Emphasizing the contribution of individual tokens, we propose a simple but effective Adaptive Scaling mechanism to capture geometric contexts while sifting out focal points. Adaptively storing and processing only focal points in historical frames dramatically reduces the overall complexity. Furthermore, a novel Grouped Hierarchical Fusion strategy is proposed, progressively performing sequence scaling and Intra-Group Fusion operations to facilitate the exchange of global spatial and temporal information. Experiments on the Waymo Open Dataset demonstrate that our FASTer significantly outperforms other state-of-the-art detectors in both performance and efficiency while also exhibiting improved flexibility and robustness. The code is available at https://github.com/MSunDYY/FASTer.git.
title FASTer: Focal Token Acquiring-and-Scaling Transformer for Long-term 3D Object Detection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2503.01899