Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908544038600704 |
|---|---|
| author | Guo, Xianda Zhang, Chenming Zhang, Youmin Wang, Ruilin Nie, Dujun Zheng, Wenzhao Poggi, Matteo Zhao, Hao Ye, Mang Zou, Qin Chen, Long |
| author_facet | Guo, Xianda Zhang, Chenming Zhang, Youmin Wang, Ruilin Nie, Dujun Zheng, Wenzhao Poggi, Matteo Zhao, Hao Ye, Mang Zou, Qin Chen, Long |
| contents | Stereo matching serves as a cornerstone in 3D vision, aiming to establish pixel-wise correspondences between stereo image pairs for depth recovery. Despite remarkable progress driven by deep neural architectures, current models often exhibit severe performance degradation when deployed in unseen domains, primarily due to the limited diversity of training data. In this work, we introduce StereoAnything, a data-centric framework that substantially enhances the zero-shot generalization capability of existing stereo models. Rather than devising yet another specialized architecture, we scale stereo training to an unprecedented level by systematically unifying heterogeneous stereo sources: (1) curated labeled datasets covering diverse environments, and (2) large-scale synthetic stereo pairs generated from unlabeled monocular images. Our mixed-data strategy delivers consistent and robust learning signals across domains, effectively mitigating dataset bias. Extensive zero-shot evaluations on four public benchmarks demonstrate that Stereo Anything achieves state-of-the-art generalization. This work paves the way towards truly universal stereo matching, offering a scalable data paradigm applicable to any stereo image pair. We extensively evaluate the zero-shot capabilities of our model on four public datasets, showcasing its impressive ability to generalize to any stereo image pair. Code is available at https://github.com/XiandaGuo/OpenStereo. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_14053 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data Guo, Xianda Zhang, Chenming Zhang, Youmin Wang, Ruilin Nie, Dujun Zheng, Wenzhao Poggi, Matteo Zhao, Hao Ye, Mang Zou, Qin Chen, Long Computer Vision and Pattern Recognition Stereo matching serves as a cornerstone in 3D vision, aiming to establish pixel-wise correspondences between stereo image pairs for depth recovery. Despite remarkable progress driven by deep neural architectures, current models often exhibit severe performance degradation when deployed in unseen domains, primarily due to the limited diversity of training data. In this work, we introduce StereoAnything, a data-centric framework that substantially enhances the zero-shot generalization capability of existing stereo models. Rather than devising yet another specialized architecture, we scale stereo training to an unprecedented level by systematically unifying heterogeneous stereo sources: (1) curated labeled datasets covering diverse environments, and (2) large-scale synthetic stereo pairs generated from unlabeled monocular images. Our mixed-data strategy delivers consistent and robust learning signals across domains, effectively mitigating dataset bias. Extensive zero-shot evaluations on four public benchmarks demonstrate that Stereo Anything achieves state-of-the-art generalization. This work paves the way towards truly universal stereo matching, offering a scalable data paradigm applicable to any stereo image pair. We extensively evaluate the zero-shot capabilities of our model on four public datasets, showcasing its impressive ability to generalize to any stereo image pair. Code is available at https://github.com/XiandaGuo/OpenStereo. |
| title | Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.14053 |