ARC-Calib: Autonomous Markerless Camera-to-Robot Calibration via Exploratory Robot Motions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chanrungmaneekul, Podshara, Chen, Yiting, Grace, Joshua T., Dollar, Aaron M., Hang, Kaiyu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916657128013824
author Chanrungmaneekul, Podshara
Chen, Yiting
Grace, Joshua T.
Dollar, Aaron M.
Hang, Kaiyu
author_facet Chanrungmaneekul, Podshara
Chen, Yiting
Grace, Joshua T.
Dollar, Aaron M.
Hang, Kaiyu
contents Camera-to-robot (also known as eye-to-hand) calibration is a critical component of vision-based robot manipulation. Traditional marker-based methods often require human intervention for system setup. Furthermore, existing autonomous markerless calibration methods typically rely on pre-trained robot tracking models that impede their application on edge devices and require fine-tuning for novel robot embodiments. To address these limitations, this paper proposes a model-based markerless camera-to-robot calibration framework, ARC-Calib, that is fully autonomous and generalizable across diverse robots and scenarios without requiring extensive data collection or learning. First, exploratory robot motions are introduced to generate easily trackable trajectory-based visual patterns in the camera's image frames. Then, a geometric optimization framework is proposed to exploit the coplanarity and collinearity constraints from the observed motions to iteratively refine the estimated calibration result. Our approach eliminates the need for extra effort in either environmental marker setup or data collection and model training, rendering it highly adaptable across a wide range of real-world autonomous systems. Extensive experiments are conducted in both simulation and the real world to validate its robustness and generalizability.
format Preprint
id arxiv_https___arxiv_org_abs_2503_14701
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ARC-Calib: Autonomous Markerless Camera-to-Robot Calibration via Exploratory Robot Motions
Chanrungmaneekul, Podshara
Chen, Yiting
Grace, Joshua T.
Dollar, Aaron M.
Hang, Kaiyu
Robotics
Computer Vision and Pattern Recognition
Camera-to-robot (also known as eye-to-hand) calibration is a critical component of vision-based robot manipulation. Traditional marker-based methods often require human intervention for system setup. Furthermore, existing autonomous markerless calibration methods typically rely on pre-trained robot tracking models that impede their application on edge devices and require fine-tuning for novel robot embodiments. To address these limitations, this paper proposes a model-based markerless camera-to-robot calibration framework, ARC-Calib, that is fully autonomous and generalizable across diverse robots and scenarios without requiring extensive data collection or learning. First, exploratory robot motions are introduced to generate easily trackable trajectory-based visual patterns in the camera's image frames. Then, a geometric optimization framework is proposed to exploit the coplanarity and collinearity constraints from the observed motions to iteratively refine the estimated calibration result. Our approach eliminates the need for extra effort in either environmental marker setup or data collection and model training, rendering it highly adaptable across a wide range of real-world autonomous systems. Extensive experiments are conducted in both simulation and the real world to validate its robustness and generalizability.
title ARC-Calib: Autonomous Markerless Camera-to-Robot Calibration via Exploratory Robot Motions
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.14701