Evolutionary Morphology Towards Overconstrained Locomotion via Large-Scale, Multi-Terrain Deep Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Yenan, Zhang, Chuye, Gu, Pengxi, Qiu, Jianuo, Yin, Jiayi, Qiu, Nuofan, Huang, Guojing, Huang, Bangchao, Zhang, Zishang, Deng, Hui, Zhang, Wei, Wan, Fang, Song, Chaoyang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910508827803648
author Chen, Yenan
Zhang, Chuye
Gu, Pengxi
Qiu, Jianuo
Yin, Jiayi
Qiu, Nuofan
Huang, Guojing
Huang, Bangchao
Zhang, Zishang
Deng, Hui
Zhang, Wei
Wan, Fang
Song, Chaoyang
author_facet Chen, Yenan
Zhang, Chuye
Gu, Pengxi
Qiu, Jianuo
Yin, Jiayi
Qiu, Nuofan
Huang, Guojing
Huang, Bangchao
Zhang, Zishang
Deng, Hui
Zhang, Wei
Wan, Fang
Song, Chaoyang
contents While the animals' Fin-to-Limb evolution has been well-researched in biology, such morphological transformation remains under-adopted in the modern design of advanced robotic limbs. This paper investigates a novel class of overconstrained locomotion from a design and learning perspective inspired by evolutionary morphology, aiming to integrate the concept of `intelligent design under constraints' - hereafter referred to as constraint-driven design intelligence - in developing modern robotic limbs with superior energy efficiency. We propose a 3D-printable design of robotic limbs parametrically reconfigurable as a classical planar 4-bar linkage, an overconstrained Bennett linkage, and a spherical 4-bar linkage. These limbs adopt a co-axial actuation, identical to the modern legged robot platforms, with the added capability of upgrading into a wheel-legged system. Then, we implemented a large-scale, multi-terrain deep reinforcement learning framework to train these reconfigurable limbs for a comparative analysis of overconstrained locomotion in energy efficiency. Results show that the overconstrained limbs exhibit more efficient locomotion than planar limbs during forward and sideways walking over different terrains, including floors, slopes, and stairs, with or without random noises, by saving at least 22% mechanical energy in completing the traverse task, with the spherical limbs being the least efficient. It also achieves the highest average speed of 0.85 meters per second on flat terrain, which is 20% faster than the planar limbs. This study paves the path for an exciting direction for future research in overconstrained robotics leveraging evolutionary morphology and reconfigurable mechanism intelligence when combined with state-of-the-art methods in deep reinforcement learning.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01050
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evolutionary Morphology Towards Overconstrained Locomotion via Large-Scale, Multi-Terrain Deep Reinforcement Learning
Chen, Yenan
Zhang, Chuye
Gu, Pengxi
Qiu, Jianuo
Yin, Jiayi
Qiu, Nuofan
Huang, Guojing
Huang, Bangchao
Zhang, Zishang
Deng, Hui
Zhang, Wei
Wan, Fang
Song, Chaoyang
Robotics
Artificial Intelligence
While the animals' Fin-to-Limb evolution has been well-researched in biology, such morphological transformation remains under-adopted in the modern design of advanced robotic limbs. This paper investigates a novel class of overconstrained locomotion from a design and learning perspective inspired by evolutionary morphology, aiming to integrate the concept of `intelligent design under constraints' - hereafter referred to as constraint-driven design intelligence - in developing modern robotic limbs with superior energy efficiency. We propose a 3D-printable design of robotic limbs parametrically reconfigurable as a classical planar 4-bar linkage, an overconstrained Bennett linkage, and a spherical 4-bar linkage. These limbs adopt a co-axial actuation, identical to the modern legged robot platforms, with the added capability of upgrading into a wheel-legged system. Then, we implemented a large-scale, multi-terrain deep reinforcement learning framework to train these reconfigurable limbs for a comparative analysis of overconstrained locomotion in energy efficiency. Results show that the overconstrained limbs exhibit more efficient locomotion than planar limbs during forward and sideways walking over different terrains, including floors, slopes, and stairs, with or without random noises, by saving at least 22% mechanical energy in completing the traverse task, with the spherical limbs being the least efficient. It also achieves the highest average speed of 0.85 meters per second on flat terrain, which is 20% faster than the planar limbs. This study paves the path for an exciting direction for future research in overconstrained robotics leveraging evolutionary morphology and reconfigurable mechanism intelligence when combined with state-of-the-art methods in deep reinforcement learning.
title Evolutionary Morphology Towards Overconstrained Locomotion via Large-Scale, Multi-Terrain Deep Reinforcement Learning
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2407.01050