Enhancing Ground-to-Aerial Image Matching for Visual Misinformation Detection Using Semantic Segmentation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mule, Emanuele, Pannacci, Matteo, Goudarzi, Ali Ghasemi, Pro, Francesco, Papa, Lorenzo, Maiano, Luca, Amerini, Irene
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912243654852608
author Mule, Emanuele
Pannacci, Matteo
Goudarzi, Ali Ghasemi
Pro, Francesco
Papa, Lorenzo
Maiano, Luca
Amerini, Irene
author_facet Mule, Emanuele
Pannacci, Matteo
Goudarzi, Ali Ghasemi
Pro, Francesco
Papa, Lorenzo
Maiano, Luca
Amerini, Irene
contents The recent advancements in generative AI techniques, which have significantly increased the online dissemination of altered images and videos, have raised serious concerns about the credibility of digital media available on the Internet and distributed through information channels and social networks. This issue particularly affects domains that rely heavily on trustworthy data, such as journalism, forensic analysis, and Earth observation. To address these concerns, the ability to geolocate a non-geo-tagged ground-view image without external information, such as GPS coordinates, has become increasingly critical. This study tackles the challenge of linking a ground-view image, potentially exhibiting varying fields of view (FoV), to its corresponding satellite image without the aid of GPS data. To achieve this, we propose a novel four-stream Siamese-like architecture, the Quadruple Semantic Align Net (SAN-QUAD), which extends previous state-of-the-art (SOTA) approaches by leveraging semantic segmentation applied to both ground and satellite imagery. Experimental results on a subset of the CVUSA dataset demonstrate significant improvements of up to 9.8% over prior methods across various FoV settings.
format Preprint
id arxiv_https___arxiv_org_abs_2502_06288
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Ground-to-Aerial Image Matching for Visual Misinformation Detection Using Semantic Segmentation
Mule, Emanuele
Pannacci, Matteo
Goudarzi, Ali Ghasemi
Pro, Francesco
Papa, Lorenzo
Maiano, Luca
Amerini, Irene
Computer Vision and Pattern Recognition
The recent advancements in generative AI techniques, which have significantly increased the online dissemination of altered images and videos, have raised serious concerns about the credibility of digital media available on the Internet and distributed through information channels and social networks. This issue particularly affects domains that rely heavily on trustworthy data, such as journalism, forensic analysis, and Earth observation. To address these concerns, the ability to geolocate a non-geo-tagged ground-view image without external information, such as GPS coordinates, has become increasingly critical. This study tackles the challenge of linking a ground-view image, potentially exhibiting varying fields of view (FoV), to its corresponding satellite image without the aid of GPS data. To achieve this, we propose a novel four-stream Siamese-like architecture, the Quadruple Semantic Align Net (SAN-QUAD), which extends previous state-of-the-art (SOTA) approaches by leveraging semantic segmentation applied to both ground and satellite imagery. Experimental results on a subset of the CVUSA dataset demonstrate significant improvements of up to 9.8% over prior methods across various FoV settings.
title Enhancing Ground-to-Aerial Image Matching for Visual Misinformation Detection Using Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.06288