Saved in:
Bibliographic Details
Main Authors: Bezick, Michael, Giammarino, Vittorio, Qureshi, Ahmed H.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.20974
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909872825565184
author Bezick, Michael
Giammarino, Vittorio
Qureshi, Ahmed H.
author_facet Bezick, Michael
Giammarino, Vittorio
Qureshi, Ahmed H.
contents Reinforcement Learning (RL) from raw visual input has achieved impressive successes in recent years, yet it remains fragile to out-of-distribution variations such as changes in lighting, color, and viewpoint. Point Cloud Reinforcement Learning (PC-RL) offers a promising alternative by mitigating appearance-based brittleness, but its sensitivity to camera pose mismatches continues to undermine reliability in realistic settings. To address this challenge, we propose PCA Point Cloud (PPC), a canonicalization framework specifically tailored for downstream robotic control. PPC maps point clouds under arbitrary rigid-body transformations to a unique canonical pose, aligning observations to a consistent frame, thereby substantially decreasing viewpoint-induced inconsistencies. In our experiments, we show that PPC improves robustness to unseen camera poses across challenging robotic tasks, providing a principled alternative to domain randomization.
format Preprint
id arxiv_https___arxiv_org_abs_2510_20974
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust Point Cloud Reinforcement Learning via PCA-Based Canonicalization
Bezick, Michael
Giammarino, Vittorio
Qureshi, Ahmed H.
Robotics
Machine Learning
Reinforcement Learning (RL) from raw visual input has achieved impressive successes in recent years, yet it remains fragile to out-of-distribution variations such as changes in lighting, color, and viewpoint. Point Cloud Reinforcement Learning (PC-RL) offers a promising alternative by mitigating appearance-based brittleness, but its sensitivity to camera pose mismatches continues to undermine reliability in realistic settings. To address this challenge, we propose PCA Point Cloud (PPC), a canonicalization framework specifically tailored for downstream robotic control. PPC maps point clouds under arbitrary rigid-body transformations to a unique canonical pose, aligning observations to a consistent frame, thereby substantially decreasing viewpoint-induced inconsistencies. In our experiments, we show that PPC improves robustness to unseen camera poses across challenging robotic tasks, providing a principled alternative to domain randomization.
title Robust Point Cloud Reinforcement Learning via PCA-Based Canonicalization
topic Robotics
Machine Learning
url https://arxiv.org/abs/2510.20974