FoVA-Depth: Field-of-View Agnostic Depth Estimation for Cross-Dataset Generalization
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909082737180672 |
|---|---|
| author | Lichy, Daniel Su, Hang Badki, Abhishek Kautz, Jan Gallo, Orazio |
| author_facet | Lichy, Daniel Su, Hang Badki, Abhishek Kautz, Jan Gallo, Orazio |
| contents | Wide field-of-view (FoV) cameras efficiently capture large portions of the scene, which makes them attractive in multiple domains, such as automotive and robotics. For such applications, estimating depth from multiple images is a critical task, and therefore, a large amount of ground truth (GT) data is available. Unfortunately, most of the GT data is for pinhole cameras, making it impossible to properly train depth estimation models for large-FoV cameras. We propose the first method to train a stereo depth estimation model on the widely available pinhole data, and to generalize it to data captured with larger FoVs. Our intuition is simple: We warp the training data to a canonical, large-FoV representation and augment it to allow a single network to reason about diverse types of distortions that otherwise would prevent generalization. We show strong generalization ability of our approach on both indoor and outdoor datasets, which was not possible with previous methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_13786 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FoVA-Depth: Field-of-View Agnostic Depth Estimation for Cross-Dataset Generalization Lichy, Daniel Su, Hang Badki, Abhishek Kautz, Jan Gallo, Orazio Computer Vision and Pattern Recognition Wide field-of-view (FoV) cameras efficiently capture large portions of the scene, which makes them attractive in multiple domains, such as automotive and robotics. For such applications, estimating depth from multiple images is a critical task, and therefore, a large amount of ground truth (GT) data is available. Unfortunately, most of the GT data is for pinhole cameras, making it impossible to properly train depth estimation models for large-FoV cameras. We propose the first method to train a stereo depth estimation model on the widely available pinhole data, and to generalize it to data captured with larger FoVs. Our intuition is simple: We warp the training data to a canonical, large-FoV representation and augment it to allow a single network to reason about diverse types of distortions that otherwise would prevent generalization. We show strong generalization ability of our approach on both indoor and outdoor datasets, which was not possible with previous methods. |
| title | FoVA-Depth: Field-of-View Agnostic Depth Estimation for Cross-Dataset Generalization |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.13786 |