EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Deshmukh, Rahul, Chauhan, Aditya, Kak, Avinash
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914413746847744
author Deshmukh, Rahul
Chauhan, Aditya
Kak, Avinash
author_facet Deshmukh, Rahul
Chauhan, Aditya
Kak, Avinash
contents The deep-learning based image matching networks can now handle significantly larger variations in viewpoints and illuminations while providing matched pairs of pixels with sub-pixel precision. These networks have been trained with ground-based image datasets and, implicitly, their performance is optimized for the pinhole camera geometry. Consequently, you get suboptimal performance when such networks are used to match satellite images since those images are synthesized as a moving satellite camera records one line at a time of the points on the ground. In this paper, we present EpiMask, a semi-dense image matching network for satellite images that (1) Incorporates patch-wise affine approximations to the camera modeling geometry; (2) Uses an epipolar distance-based attention mask to restrict cross-attention to geometrically plausible regions; and (3) That fine-tunes a foundational pretrained image encoder for robust feature extraction. Experiments on the SatDepth dataset demonstrate up to 30% improvement in matching accuracy compared to re-trained ground-based models.
format Preprint
id arxiv_https___arxiv_org_abs_2603_21463
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching
Deshmukh, Rahul
Chauhan, Aditya
Kak, Avinash
Computer Vision and Pattern Recognition
The deep-learning based image matching networks can now handle significantly larger variations in viewpoints and illuminations while providing matched pairs of pixels with sub-pixel precision. These networks have been trained with ground-based image datasets and, implicitly, their performance is optimized for the pinhole camera geometry. Consequently, you get suboptimal performance when such networks are used to match satellite images since those images are synthesized as a moving satellite camera records one line at a time of the points on the ground. In this paper, we present EpiMask, a semi-dense image matching network for satellite images that (1) Incorporates patch-wise affine approximations to the camera modeling geometry; (2) Uses an epipolar distance-based attention mask to restrict cross-attention to geometrically plausible regions; and (3) That fine-tunes a foundational pretrained image encoder for robust feature extraction. Experiments on the SatDepth dataset demonstrate up to 30% improvement in matching accuracy compared to re-trained ground-based models.
title EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.21463