VertiCoder: Self-Supervised Kinodynamic Representation Learning on Vertically Challenging Terrain

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nazeri, Mohammad, Datar, Aniket, Pokhrel, Anuj, Pan, Chenhui, Warnell, Garrett, Xiao, Xuesu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910861950451712
author Nazeri, Mohammad
Datar, Aniket
Pokhrel, Anuj
Pan, Chenhui
Warnell, Garrett
Xiao, Xuesu
author_facet Nazeri, Mohammad
Datar, Aniket
Pokhrel, Anuj
Pan, Chenhui
Warnell, Garrett
Xiao, Xuesu
contents We present VertiCoder, a self-supervised representation learning approach for robot mobility on vertically challenging terrain. Using the same pre-training process, VertiCoder can handle four different downstream tasks, including forward kinodynamics learning, inverse kinodynamics learning, behavior cloning, and patch reconstruction with a single representation. VertiCoder uses a TransformerEncoder to learn the local context of its surroundings by random masking and next patch reconstruction. We show that VertiCoder achieves better performance across all four different tasks compared to specialized End-to-End models with 77% fewer parameters. We also show VertiCoder's comparable performance against state-of-the-art kinodynamic modeling and planning approaches in real-world robot deployment. These results underscore the efficacy of VertiCoder in mitigating overfitting and fostering more robust generalization across diverse environmental contexts and downstream vehicle kinodynamic tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11570
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle VertiCoder: Self-Supervised Kinodynamic Representation Learning on Vertically Challenging Terrain
Nazeri, Mohammad
Datar, Aniket
Pokhrel, Anuj
Pan, Chenhui
Warnell, Garrett
Xiao, Xuesu
Robotics
We present VertiCoder, a self-supervised representation learning approach for robot mobility on vertically challenging terrain. Using the same pre-training process, VertiCoder can handle four different downstream tasks, including forward kinodynamics learning, inverse kinodynamics learning, behavior cloning, and patch reconstruction with a single representation. VertiCoder uses a TransformerEncoder to learn the local context of its surroundings by random masking and next patch reconstruction. We show that VertiCoder achieves better performance across all four different tasks compared to specialized End-to-End models with 77% fewer parameters. We also show VertiCoder's comparable performance against state-of-the-art kinodynamic modeling and planning approaches in real-world robot deployment. These results underscore the efficacy of VertiCoder in mitigating overfitting and fostering more robust generalization across diverse environmental contexts and downstream vehicle kinodynamic tasks.
title VertiCoder: Self-Supervised Kinodynamic Representation Learning on Vertically Challenging Terrain
topic Robotics
url https://arxiv.org/abs/2409.11570