BANet: Bilateral Aggregation Network for Mobile Stereo Matching

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xu, Gangwei, Liu, Jiaxin, Wang, Xianqi, Cheng, Junda, Deng, Yong, Zang, Jinliang, Chen, Yurui, Yang, Xin
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911035709980672
author Xu, Gangwei
Liu, Jiaxin
Wang, Xianqi
Cheng, Junda
Deng, Yong
Zang, Jinliang
Chen, Yurui
Yang, Xin
author_facet Xu, Gangwei
Liu, Jiaxin
Wang, Xianqi
Cheng, Junda
Deng, Yong
Zang, Jinliang
Chen, Yurui
Yang, Xin
contents State-of-the-art stereo matching methods typically use costly 3D convolutions to aggregate a full cost volume, but their computational demands make mobile deployment challenging. Directly applying 2D convolutions for cost aggregation often results in edge blurring, detail loss, and mismatches in textureless regions. Some complex operations, like deformable convolutions and iterative warping, can partially alleviate this issue; however, they are not mobile-friendly, limiting their deployment on mobile devices. In this paper, we present a novel bilateral aggregation network (BANet) for mobile stereo matching that produces high-quality results with sharp edges and fine details using only 2D convolutions. Specifically, we first separate the full cost volume into detailed and smooth volumes using a spatial attention map, then perform detailed and smooth aggregations accordingly, ultimately fusing both to obtain the final disparity map. Experimental results demonstrate that our BANet-2D significantly outperforms other mobile-friendly methods, achieving 35.3\% higher accuracy on the KITTI 2015 leaderboard than MobileStereoNet-2D, with faster runtime on mobile devices. Code: \textcolor{magenta}{https://github.com/gangweix/BANet}.
format Preprint
id arxiv_https___arxiv_org_abs_2503_03259
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BANet: Bilateral Aggregation Network for Mobile Stereo Matching
Xu, Gangwei
Liu, Jiaxin
Wang, Xianqi
Cheng, Junda
Deng, Yong
Zang, Jinliang
Chen, Yurui
Yang, Xin
Computer Vision and Pattern Recognition
State-of-the-art stereo matching methods typically use costly 3D convolutions to aggregate a full cost volume, but their computational demands make mobile deployment challenging. Directly applying 2D convolutions for cost aggregation often results in edge blurring, detail loss, and mismatches in textureless regions. Some complex operations, like deformable convolutions and iterative warping, can partially alleviate this issue; however, they are not mobile-friendly, limiting their deployment on mobile devices. In this paper, we present a novel bilateral aggregation network (BANet) for mobile stereo matching that produces high-quality results with sharp edges and fine details using only 2D convolutions. Specifically, we first separate the full cost volume into detailed and smooth volumes using a spatial attention map, then perform detailed and smooth aggregations accordingly, ultimately fusing both to obtain the final disparity map. Experimental results demonstrate that our BANet-2D significantly outperforms other mobile-friendly methods, achieving 35.3\% higher accuracy on the KITTI 2015 leaderboard than MobileStereoNet-2D, with faster runtime on mobile devices. Code: \textcolor{magenta}{https://github.com/gangweix/BANet}.
title BANet: Bilateral Aggregation Network for Mobile Stereo Matching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.03259