Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913236219068416 |
|---|---|
| author | Nguyen, Thang-Anh-Quan Bourki, Amine Macudzinski, Mátyás Brunel, Anthony Bennamoun, Mohammed |
| author_facet | Nguyen, Thang-Anh-Quan Bourki, Amine Macudzinski, Mátyás Brunel, Anthony Bennamoun, Mohammed |
| contents | This review thoroughly examines the role of semantically-aware Neural Radiance Fields (NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It explores how NeRFs adeptly infer 3D representations for both stationary and dynamic objects in a scene. This capability is pivotal for generating high-quality new viewpoints, completing missing scene details (inpainting), conducting comprehensive scene segmentation (panoptic segmentation), predicting 3D bounding boxes, editing 3D scenes, and extracting object-centric 3D models. A significant aspect of this study is the application of semantic labels as viewpoint-invariant functions, which effectively map spatial coordinates to a spectrum of semantic labels, thus facilitating the recognition of distinct objects within the scene. Overall, this survey highlights the progression and diverse applications of semantically-aware neural radiance fields in the context of visual scene interpretation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_11141 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review Nguyen, Thang-Anh-Quan Bourki, Amine Macudzinski, Mátyás Brunel, Anthony Bennamoun, Mohammed Computer Vision and Pattern Recognition This review thoroughly examines the role of semantically-aware Neural Radiance Fields (NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It explores how NeRFs adeptly infer 3D representations for both stationary and dynamic objects in a scene. This capability is pivotal for generating high-quality new viewpoints, completing missing scene details (inpainting), conducting comprehensive scene segmentation (panoptic segmentation), predicting 3D bounding boxes, editing 3D scenes, and extracting object-centric 3D models. A significant aspect of this study is the application of semantic labels as viewpoint-invariant functions, which effectively map spatial coordinates to a spectrum of semantic labels, thus facilitating the recognition of distinct objects within the scene. Overall, this survey highlights the progression and diverse applications of semantically-aware neural radiance fields in the context of visual scene interpretation. |
| title | Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2402.11141 |