Geometry-Aware Feature Matching for Large-Scale Structure from Motion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910939657273344 |
|---|---|
| author | Chen, Gonglin Wu, Jinsen Chen, Haiwei Teng, Wenbin Gao, Zhiyuan Feng, Andrew Qin, Rongjun Zhao, Yajie |
| author_facet | Chen, Gonglin Wu, Jinsen Chen, Haiwei Teng, Wenbin Gao, Zhiyuan Feng, Andrew Qin, Rongjun Zhao, Yajie |
| contents | Establishing consistent and dense correspondences across multiple images is crucial for Structure from Motion (SfM) systems. Significant view changes, such as air-to-ground with very sparse view overlap, pose an even greater challenge to the correspondence solvers. We present a novel optimization-based approach that significantly enhances existing feature matching methods by introducing geometry cues in addition to color cues. This helps fill gaps when there is less overlap in large-scale scenarios. Our method formulates geometric verification as an optimization problem, guiding feature matching within detector-free methods and using sparse correspondences from detector-based methods as anchor points. By enforcing geometric constraints via the Sampson Distance, our approach ensures that the denser correspondences from detector-free methods are geometrically consistent and more accurate. This hybrid strategy significantly improves correspondence density and accuracy, mitigates multi-view inconsistencies, and leads to notable advancements in camera pose accuracy and point cloud density. It outperforms state-of-the-art feature matching methods on benchmark datasets and enables feature matching in challenging extreme large-scale settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_02310 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Geometry-Aware Feature Matching for Large-Scale Structure from Motion Chen, Gonglin Wu, Jinsen Chen, Haiwei Teng, Wenbin Gao, Zhiyuan Feng, Andrew Qin, Rongjun Zhao, Yajie Computer Vision and Pattern Recognition Establishing consistent and dense correspondences across multiple images is crucial for Structure from Motion (SfM) systems. Significant view changes, such as air-to-ground with very sparse view overlap, pose an even greater challenge to the correspondence solvers. We present a novel optimization-based approach that significantly enhances existing feature matching methods by introducing geometry cues in addition to color cues. This helps fill gaps when there is less overlap in large-scale scenarios. Our method formulates geometric verification as an optimization problem, guiding feature matching within detector-free methods and using sparse correspondences from detector-based methods as anchor points. By enforcing geometric constraints via the Sampson Distance, our approach ensures that the denser correspondences from detector-free methods are geometrically consistent and more accurate. This hybrid strategy significantly improves correspondence density and accuracy, mitigates multi-view inconsistencies, and leads to notable advancements in camera pose accuracy and point cloud density. It outperforms state-of-the-art feature matching methods on benchmark datasets and enables feature matching in challenging extreme large-scale settings. |
| title | Geometry-Aware Feature Matching for Large-Scale Structure from Motion |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.02310 |