Real-Time Fusion of Visual and Chart Data for Enhanced Maritime Vision

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kreis, Marten, Kiefer, Benjamin
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918097219223552
author Kreis, Marten
Kiefer, Benjamin
author_facet Kreis, Marten
Kiefer, Benjamin
contents This paper presents a novel approach to enhancing marine vision by fusing real-time visual data with chart information. Our system overlays nautical chart data onto live video feeds by accurately matching detected navigational aids, such as buoys, with their corresponding representations in chart data. To achieve robust association, we introduce a transformer-based end-to-end neural network that predicts bounding boxes and confidence scores for buoy queries, enabling the direct matching of image-domain detections with world-space chart markers. The proposed method is compared against baseline approaches, including a ray-casting model that estimates buoy positions via camera projection and a YOLOv7-based network extended with a distance estimation module. Experimental results on a dataset of real-world maritime scenes demonstrate that our approach significantly improves object localization and association accuracy in dynamic and challenging environments.
format Preprint
id arxiv_https___arxiv_org_abs_2507_13880
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Real-Time Fusion of Visual and Chart Data for Enhanced Maritime Vision
Kreis, Marten
Kiefer, Benjamin
Computer Vision and Pattern Recognition
Artificial Intelligence
This paper presents a novel approach to enhancing marine vision by fusing real-time visual data with chart information. Our system overlays nautical chart data onto live video feeds by accurately matching detected navigational aids, such as buoys, with their corresponding representations in chart data. To achieve robust association, we introduce a transformer-based end-to-end neural network that predicts bounding boxes and confidence scores for buoy queries, enabling the direct matching of image-domain detections with world-space chart markers. The proposed method is compared against baseline approaches, including a ray-casting model that estimates buoy positions via camera projection and a YOLOv7-based network extended with a distance estimation module. Experimental results on a dataset of real-world maritime scenes demonstrate that our approach significantly improves object localization and association accuracy in dynamic and challenging environments.
title Real-Time Fusion of Visual and Chart Data for Enhanced Maritime Vision
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2507.13880