Graph Learning-Driven Multi-Vessel Association: Fusing Multimodal Data for Maritime Intelligence

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lu, Yuxu, Yang, Kaisen, Yang, Dong, Ding, Haifeng, Weng, Jinxian, Liu, Ryan Wen
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909578224992256
author Lu, Yuxu
Yang, Kaisen
Yang, Dong
Ding, Haifeng
Weng, Jinxian
Liu, Ryan Wen
author_facet Lu, Yuxu
Yang, Kaisen
Yang, Dong
Ding, Haifeng
Weng, Jinxian
Liu, Ryan Wen
contents Ensuring maritime safety and optimizing traffic management in increasingly crowded and complex waterways require effective waterway monitoring. However, current methods struggle with challenges arising from multimodal data, such as dimensional disparities, mismatched target counts, vessel scale variations, occlusions, and asynchronous data streams from systems like the automatic identification system (AIS) and closed-circuit television (CCTV). Traditional multi-target association methods often struggle with these complexities, particularly in densely trafficked waterways. To overcome these issues, we propose a graph learning-driven multi-vessel association (GMvA) method tailored for maritime multimodal data fusion. By integrating AIS and CCTV data, GMvA leverages time series learning and graph neural networks to capture the spatiotemporal features of vessel trajectories effectively. To enhance feature representation, the proposed method incorporates temporal graph attention and spatiotemporal attention, effectively capturing both local and global vessel interactions. Furthermore, a multi-layer perceptron-based uncertainty fusion module computes robust similarity scores, and the Hungarian algorithm is adopted to ensure globally consistent and accurate target matching. Extensive experiments on real-world maritime datasets confirm that GMvA delivers superior accuracy and robustness in multi-target association, outperforming existing methods even in challenging scenarios with high vessel density and incomplete or unevenly distributed AIS and CCTV data.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09197
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Graph Learning-Driven Multi-Vessel Association: Fusing Multimodal Data for Maritime Intelligence
Lu, Yuxu
Yang, Kaisen
Yang, Dong
Ding, Haifeng
Weng, Jinxian
Liu, Ryan Wen
Artificial Intelligence
Ensuring maritime safety and optimizing traffic management in increasingly crowded and complex waterways require effective waterway monitoring. However, current methods struggle with challenges arising from multimodal data, such as dimensional disparities, mismatched target counts, vessel scale variations, occlusions, and asynchronous data streams from systems like the automatic identification system (AIS) and closed-circuit television (CCTV). Traditional multi-target association methods often struggle with these complexities, particularly in densely trafficked waterways. To overcome these issues, we propose a graph learning-driven multi-vessel association (GMvA) method tailored for maritime multimodal data fusion. By integrating AIS and CCTV data, GMvA leverages time series learning and graph neural networks to capture the spatiotemporal features of vessel trajectories effectively. To enhance feature representation, the proposed method incorporates temporal graph attention and spatiotemporal attention, effectively capturing both local and global vessel interactions. Furthermore, a multi-layer perceptron-based uncertainty fusion module computes robust similarity scores, and the Hungarian algorithm is adopted to ensure globally consistent and accurate target matching. Extensive experiments on real-world maritime datasets confirm that GMvA delivers superior accuracy and robustness in multi-target association, outperforming existing methods even in challenging scenarios with high vessel density and incomplete or unevenly distributed AIS and CCTV data.
title Graph Learning-Driven Multi-Vessel Association: Fusing Multimodal Data for Maritime Intelligence
topic Artificial Intelligence
url https://arxiv.org/abs/2504.09197