Image Patch-Matching with Graph-Based Learning in Street Scenes
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910398738857984 |
|---|---|
| author | She, Rui Kang, Qiyu Wang, Sijie Tay, Wee Peng Guan, Yong Liang Navarro, Diego Navarro Hartmannsgruber, Andreas |
| author_facet | She, Rui Kang, Qiyu Wang, Sijie Tay, Wee Peng Guan, Yong Liang Navarro, Diego Navarro Hartmannsgruber, Andreas |
| contents | Matching landmark patches from a real-time image captured by an on-vehicle camera with landmark patches in an image database plays an important role in various computer perception tasks for autonomous driving. Current methods focus on local matching for regions of interest and do not take into account spatial neighborhood relationships among the image patches, which typically correspond to objects in the environment. In this paper, we construct a spatial graph with the graph vertices corresponding to patches and edges capturing the spatial neighborhood information. We propose a joint feature and metric learning model with graph-based learning. We provide a theoretical basis for the graph-based loss by showing that the information distance between the distributions conditioned on matched and unmatched pairs is maximized under our framework. We evaluate our model using several street-scene datasets and demonstrate that our approach achieves state-of-the-art matching results. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_04617 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Image Patch-Matching with Graph-Based Learning in Street Scenes She, Rui Kang, Qiyu Wang, Sijie Tay, Wee Peng Guan, Yong Liang Navarro, Diego Navarro Hartmannsgruber, Andreas Computer Vision and Pattern Recognition Matching landmark patches from a real-time image captured by an on-vehicle camera with landmark patches in an image database plays an important role in various computer perception tasks for autonomous driving. Current methods focus on local matching for regions of interest and do not take into account spatial neighborhood relationships among the image patches, which typically correspond to objects in the environment. In this paper, we construct a spatial graph with the graph vertices corresponding to patches and edges capturing the spatial neighborhood information. We propose a joint feature and metric learning model with graph-based learning. We provide a theoretical basis for the graph-based loss by showing that the information distance between the distributions conditioned on matched and unmatched pairs is maximized under our framework. We evaluate our model using several street-scene datasets and demonstrate that our approach achieves state-of-the-art matching results. |
| title | Image Patch-Matching with Graph-Based Learning in Street Scenes |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2311.04617 |