Learning Intra-view and Cross-view Geometric Knowledge for Stereo Matching

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gong, Rui, Liu, Weide, Gu, Zaiwang, Yang, Xulei, Cheng, Jun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910354747949056
author Gong, Rui
Liu, Weide
Gu, Zaiwang
Yang, Xulei
Cheng, Jun
author_facet Gong, Rui
Liu, Weide
Gu, Zaiwang
Yang, Xulei
Cheng, Jun
contents Geometric knowledge has been shown to be beneficial for the stereo matching task. However, prior attempts to integrate geometric insights into stereo matching algorithms have largely focused on geometric knowledge from single images while crucial cross-view factors such as occlusion and matching uniqueness have been overlooked. To address this gap, we propose a novel Intra-view and Cross-view Geometric knowledge learning Network (ICGNet), specifically crafted to assimilate both intra-view and cross-view geometric knowledge. ICGNet harnesses the power of interest points to serve as a channel for intra-view geometric understanding. Simultaneously, it employs the correspondences among these points to capture cross-view geometric relationships. This dual incorporation empowers the proposed ICGNet to leverage both intra-view and cross-view geometric knowledge in its learning process, substantially improving its ability to estimate disparities. Our extensive experiments demonstrate the superiority of the ICGNet over contemporary leading models.
format Preprint
id arxiv_https___arxiv_org_abs_2402_19270
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Intra-view and Cross-view Geometric Knowledge for Stereo Matching
Gong, Rui
Liu, Weide
Gu, Zaiwang
Yang, Xulei
Cheng, Jun
Computer Vision and Pattern Recognition
Geometric knowledge has been shown to be beneficial for the stereo matching task. However, prior attempts to integrate geometric insights into stereo matching algorithms have largely focused on geometric knowledge from single images while crucial cross-view factors such as occlusion and matching uniqueness have been overlooked. To address this gap, we propose a novel Intra-view and Cross-view Geometric knowledge learning Network (ICGNet), specifically crafted to assimilate both intra-view and cross-view geometric knowledge. ICGNet harnesses the power of interest points to serve as a channel for intra-view geometric understanding. Simultaneously, it employs the correspondences among these points to capture cross-view geometric relationships. This dual incorporation empowers the proposed ICGNet to leverage both intra-view and cross-view geometric knowledge in its learning process, substantially improving its ability to estimate disparities. Our extensive experiments demonstrate the superiority of the ICGNet over contemporary leading models.
title Learning Intra-view and Cross-view Geometric Knowledge for Stereo Matching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.19270