2.5D Object Detection for Intelligent Roadside Infrastructure

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Polley, Nikolai, Boualili, Yacin, Mütsch, Ferdinand, Zipfl, Maximilian, Fleck, Tobias, Zöllner, J. Marius
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913944059248640
author Polley, Nikolai
Boualili, Yacin
Mütsch, Ferdinand
Zipfl, Maximilian
Fleck, Tobias
Zöllner, J. Marius
author_facet Polley, Nikolai
Boualili, Yacin
Mütsch, Ferdinand
Zipfl, Maximilian
Fleck, Tobias
Zöllner, J. Marius
contents On-board sensors of autonomous vehicles can be obstructed, occluded, or limited by restricted fields of view, complicating downstream driving decisions. Intelligent roadside infrastructure perception systems, installed at elevated vantage points, can provide wide, unobstructed intersection coverage, supplying a complementary information stream to autonomous vehicles via vehicle-to-everything (V2X) communication. However, conventional 3D object-detection algorithms struggle to generalize under the domain shift introduced by top-down perspectives and steep camera angles. We introduce a 2.5D object detection framework, tailored specifically for infrastructure roadside-mounted cameras. Unlike conventional 2D or 3D object detection, we employ a prediction approach to detect ground planes of vehicles as parallelograms in the image frame. The parallelogram preserves the planar position, size, and orientation of objects while omitting their height, which is unnecessary for most downstream applications. For training, a mix of real-world and synthetically generated scenes is leveraged. We evaluate generalizability on a held-out camera viewpoint and in adverse-weather scenarios absent from the training set. Our results show high detection accuracy, strong cross-viewpoint generalization, and robustness to diverse lighting and weather conditions. Model weights and inference code are provided at: https://gitlab.kit.edu/kit/aifb/ATKS/public/digit4taf/2.5d-object-detection
format Preprint
id arxiv_https___arxiv_org_abs_2507_03564
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle 2.5D Object Detection for Intelligent Roadside Infrastructure
Polley, Nikolai
Boualili, Yacin
Mütsch, Ferdinand
Zipfl, Maximilian
Fleck, Tobias
Zöllner, J. Marius
Computer Vision and Pattern Recognition
Machine Learning
On-board sensors of autonomous vehicles can be obstructed, occluded, or limited by restricted fields of view, complicating downstream driving decisions. Intelligent roadside infrastructure perception systems, installed at elevated vantage points, can provide wide, unobstructed intersection coverage, supplying a complementary information stream to autonomous vehicles via vehicle-to-everything (V2X) communication. However, conventional 3D object-detection algorithms struggle to generalize under the domain shift introduced by top-down perspectives and steep camera angles. We introduce a 2.5D object detection framework, tailored specifically for infrastructure roadside-mounted cameras. Unlike conventional 2D or 3D object detection, we employ a prediction approach to detect ground planes of vehicles as parallelograms in the image frame. The parallelogram preserves the planar position, size, and orientation of objects while omitting their height, which is unnecessary for most downstream applications. For training, a mix of real-world and synthetically generated scenes is leveraged. We evaluate generalizability on a held-out camera viewpoint and in adverse-weather scenarios absent from the training set. Our results show high detection accuracy, strong cross-viewpoint generalization, and robustness to diverse lighting and weather conditions. Model weights and inference code are provided at: https://gitlab.kit.edu/kit/aifb/ATKS/public/digit4taf/2.5d-object-detection
title 2.5D Object Detection for Intelligent Roadside Infrastructure
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2507.03564