Saved in:
Bibliographic Details
Main Authors: Aguina-Kang, Rio, Blackburn-Matzen, Kevin James, Groueix, Thibault, Kim, Vladimir, Gadelha, Matheus
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.04053
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915795589660672
author Aguina-Kang, Rio
Blackburn-Matzen, Kevin James
Groueix, Thibault
Kim, Vladimir
Gadelha, Matheus
author_facet Aguina-Kang, Rio
Blackburn-Matzen, Kevin James
Groueix, Thibault
Kim, Vladimir
Gadelha, Matheus
contents We present SeeingThroughClutter, a method for reconstructing structured 3D representations from single images by segmenting and modeling objects individually. Prior approaches rely on intermediate tasks such as semantic segmentation and depth estimation, which often underperform in complex scenes, particularly in the presence of occlusion and clutter. We address this by introducing an iterative object removal and reconstruction pipeline that decomposes complex scenes into a sequence of simpler subtasks. Using VLMs as orchestrators, foreground objects are removed one at a time via detection, segmentation, object removal, and 3D fitting. We show that removing objects allows for cleaner segmentations of subsequent objects, even in highly occluded scenes. Our method requires no task-specific training and benefits directly from ongoing advances in foundation models. We demonstrate stateof-the-art robustness on 3D-Front and ADE20K datasets. Project Page: https://rioak.github.io/seeingthroughclutter/
format Preprint
id arxiv_https___arxiv_org_abs_2602_04053
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Seeing Through Clutter: Structured 3D Scene Reconstruction via Iterative Object Removal
Aguina-Kang, Rio
Blackburn-Matzen, Kevin James
Groueix, Thibault
Kim, Vladimir
Gadelha, Matheus
Computer Vision and Pattern Recognition
We present SeeingThroughClutter, a method for reconstructing structured 3D representations from single images by segmenting and modeling objects individually. Prior approaches rely on intermediate tasks such as semantic segmentation and depth estimation, which often underperform in complex scenes, particularly in the presence of occlusion and clutter. We address this by introducing an iterative object removal and reconstruction pipeline that decomposes complex scenes into a sequence of simpler subtasks. Using VLMs as orchestrators, foreground objects are removed one at a time via detection, segmentation, object removal, and 3D fitting. We show that removing objects allows for cleaner segmentations of subsequent objects, even in highly occluded scenes. Our method requires no task-specific training and benefits directly from ongoing advances in foundation models. We demonstrate stateof-the-art robustness on 3D-Front and ADE20K datasets. Project Page: https://rioak.github.io/seeingthroughclutter/
title Seeing Through Clutter: Structured 3D Scene Reconstruction via Iterative Object Removal
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.04053