Saved in:
Bibliographic Details
Main Authors: Okunevich, Iaroslav, Lombard, Alexandre, Krajnik, Tomas, Ruichek, Yassine, Yan, Zhi
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.11495
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929758791532544
author Okunevich, Iaroslav
Lombard, Alexandre
Krajnik, Tomas
Ruichek, Yassine
Yan, Zhi
author_facet Okunevich, Iaroslav
Lombard, Alexandre
Krajnik, Tomas
Ruichek, Yassine
Yan, Zhi
contents Robot social navigation needs to adapt to different human factors and environmental contexts. However, since these factors and contexts are difficult to predict and cannot be exhaustively enumerated, traditional learning-based methods have difficulty in ensuring the social attributes of robots in long-term and cross-environment deployments. This letter introduces an online context learning method that aims to empower robots to adapt to new social environments online. The proposed method adopts a two-layer structure. The bottom layer is built using a deep reinforcement learning-based method to ensure the output of basic robot navigation commands. The upper layer is implemented using an online robot learning-based method to socialize the control commands suggested by the bottom layer. Experiments using a community-wide simulator show that our method outperforms the state-of-the-art ones. Experimental results in the most challenging scenarios show that our method improves the performance of the state-of-the-art by 8%. The source code of the proposed method, the data used, and the tools for the per-training step are publicly available at https://github.com/Nedzhaken/SOCSARL-OL.
format Preprint
id arxiv_https___arxiv_org_abs_2406_11495
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Online Context Learning for Socially Compliant Navigation
Okunevich, Iaroslav
Lombard, Alexandre
Krajnik, Tomas
Ruichek, Yassine
Yan, Zhi
Robotics
Artificial Intelligence
Robot social navigation needs to adapt to different human factors and environmental contexts. However, since these factors and contexts are difficult to predict and cannot be exhaustively enumerated, traditional learning-based methods have difficulty in ensuring the social attributes of robots in long-term and cross-environment deployments. This letter introduces an online context learning method that aims to empower robots to adapt to new social environments online. The proposed method adopts a two-layer structure. The bottom layer is built using a deep reinforcement learning-based method to ensure the output of basic robot navigation commands. The upper layer is implemented using an online robot learning-based method to socialize the control commands suggested by the bottom layer. Experiments using a community-wide simulator show that our method outperforms the state-of-the-art ones. Experimental results in the most challenging scenarios show that our method improves the performance of the state-of-the-art by 8%. The source code of the proposed method, the data used, and the tools for the per-training step are publicly available at https://github.com/Nedzhaken/SOCSARL-OL.
title Online Context Learning for Socially Compliant Navigation
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2406.11495