Tidiness Score-Guided Monte Carlo Tree Search for Visual Tabletop Rearrangement

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kee, Hogun, Oh, Wooseok, Kang, Minjae, Ahn, Hyemin, Oh, Songhwai
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929729139900416
author Kee, Hogun
Oh, Wooseok
Kang, Minjae
Ahn, Hyemin
Oh, Songhwai
author_facet Kee, Hogun
Oh, Wooseok
Kang, Minjae
Ahn, Hyemin
Oh, Songhwai
contents In this paper, we present the tidiness score-guided Monte Carlo tree search (TSMCTS), a novel framework designed to address the tabletop tidying up problem using only an RGB-D camera. We address two major problems for tabletop tidying up problem: (1) the lack of public datasets and benchmarks, and (2) the difficulty of specifying the goal configuration of unseen objects. We address the former by presenting the tabletop tidying up (TTU) dataset, a structured dataset collected in simulation. Using this dataset, we train a vision-based discriminator capable of predicting the tidiness score. This discriminator can consistently evaluate the degree of tidiness across unseen configurations, including real-world scenes. Addressing the second problem, we employ Monte Carlo tree search (MCTS) to find tidying trajectories without specifying explicit goals. Instead of providing specific goals, we demonstrate that our MCTS-based planner can find diverse tidied configurations using the tidiness score as a guidance. Consequently, we propose TSMCTS, which integrates a tidiness discriminator with an MCTS-based tidying planner to find optimal tidied arrangements. TSMCTS has successfully demonstrated its capability across various environments, including coffee tables, dining tables, office desks, and bathrooms. The TTU dataset is available at: https://github.com/rllab-snu/TTU-Dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2502_17235
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tidiness Score-Guided Monte Carlo Tree Search for Visual Tabletop Rearrangement
Kee, Hogun
Oh, Wooseok
Kang, Minjae
Ahn, Hyemin
Oh, Songhwai
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
In this paper, we present the tidiness score-guided Monte Carlo tree search (TSMCTS), a novel framework designed to address the tabletop tidying up problem using only an RGB-D camera. We address two major problems for tabletop tidying up problem: (1) the lack of public datasets and benchmarks, and (2) the difficulty of specifying the goal configuration of unseen objects. We address the former by presenting the tabletop tidying up (TTU) dataset, a structured dataset collected in simulation. Using this dataset, we train a vision-based discriminator capable of predicting the tidiness score. This discriminator can consistently evaluate the degree of tidiness across unseen configurations, including real-world scenes. Addressing the second problem, we employ Monte Carlo tree search (MCTS) to find tidying trajectories without specifying explicit goals. Instead of providing specific goals, we demonstrate that our MCTS-based planner can find diverse tidied configurations using the tidiness score as a guidance. Consequently, we propose TSMCTS, which integrates a tidiness discriminator with an MCTS-based tidying planner to find optimal tidied arrangements. TSMCTS has successfully demonstrated its capability across various environments, including coffee tables, dining tables, office desks, and bathrooms. The TTU dataset is available at: https://github.com/rllab-snu/TTU-Dataset.
title Tidiness Score-Guided Monte Carlo Tree Search for Visual Tabletop Rearrangement
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2502.17235