RoboDesign1M: A Large-scale Dataset for Robot Design Understanding

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Le, Tri, Nguyen, Toan, Tran, Quang, Nguyen, Quang, Huang, Baoru, Nguyen, Hoan, Vu, Minh Nhat, Ta, Tung D., Nguyen, Anh
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909532465135616
author Le, Tri
Nguyen, Toan
Tran, Quang
Nguyen, Quang
Huang, Baoru
Nguyen, Hoan
Vu, Minh Nhat
Ta, Tung D.
Nguyen, Anh
author_facet Le, Tri
Nguyen, Toan
Tran, Quang
Nguyen, Quang
Huang, Baoru
Nguyen, Hoan
Vu, Minh Nhat
Ta, Tung D.
Nguyen, Anh
contents Robot design is a complex and time-consuming process that requires specialized expertise. Gaining a deeper understanding of robot design data can enable various applications, including automated design generation, retrieving example designs from text, and developing AI-powered design assistants. While recent advancements in foundation models present promising approaches to addressing these challenges, progress in this field is hindered by the lack of large-scale design datasets. In this paper, we introduce RoboDesign1M, a large-scale dataset comprising 1 million samples. Our dataset features multimodal data collected from scientific literature, covering various robotics domains. We propose a semi-automated data collection pipeline, enabling efficient and diverse data acquisition. To assess the effectiveness of RoboDesign1M, we conduct extensive experiments across multiple tasks, including design image generation, visual question answering about designs, and design image retrieval. The results demonstrate that our dataset serves as a challenging new benchmark for design understanding tasks and has the potential to advance research in this field. RoboDesign1M will be released to support further developments in AI-driven robotic design automation.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06796
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RoboDesign1M: A Large-scale Dataset for Robot Design Understanding
Le, Tri
Nguyen, Toan
Tran, Quang
Nguyen, Quang
Huang, Baoru
Nguyen, Hoan
Vu, Minh Nhat
Ta, Tung D.
Nguyen, Anh
Robotics
Robot design is a complex and time-consuming process that requires specialized expertise. Gaining a deeper understanding of robot design data can enable various applications, including automated design generation, retrieving example designs from text, and developing AI-powered design assistants. While recent advancements in foundation models present promising approaches to addressing these challenges, progress in this field is hindered by the lack of large-scale design datasets. In this paper, we introduce RoboDesign1M, a large-scale dataset comprising 1 million samples. Our dataset features multimodal data collected from scientific literature, covering various robotics domains. We propose a semi-automated data collection pipeline, enabling efficient and diverse data acquisition. To assess the effectiveness of RoboDesign1M, we conduct extensive experiments across multiple tasks, including design image generation, visual question answering about designs, and design image retrieval. The results demonstrate that our dataset serves as a challenging new benchmark for design understanding tasks and has the potential to advance research in this field. RoboDesign1M will be released to support further developments in AI-driven robotic design automation.
title RoboDesign1M: A Large-scale Dataset for Robot Design Understanding
topic Robotics
url https://arxiv.org/abs/2503.06796