Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912021907243008 |
|---|---|
| author | Liao, Zimu Chen, Siyan Fu, Rong Wang, Yi Su, Zhongling Luo, Hao Ma, Li Xu, Linning Dai, Bo Li, Hengjie Pei, Zhilin Zhang, Xingcheng |
| author_facet | Liao, Zimu Chen, Siyan Fu, Rong Wang, Yi Su, Zhongling Luo, Hao Ma, Li Xu, Linning Dai, Bo Li, Hengjie Pei, Zhilin Zhang, Xingcheng |
| contents | Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_04751 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras Liao, Zimu Chen, Siyan Fu, Rong Wang, Yi Su, Zhongling Luo, Hao Ma, Li Xu, Linning Dai, Bo Li, Hengjie Pei, Zhilin Zhang, Xingcheng Computer Vision and Pattern Recognition Graphics Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality. |
| title | Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras |
| topic | Computer Vision and Pattern Recognition Graphics |
| url | https://arxiv.org/abs/2409.04751 |