QuietPaw: Learning Quadrupedal Locomotion with Versatile Noise Preference Alignment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Yuyou, Yao, Yihang, Liu, Shiqi, Niu, Yaru, Lin, Changyi, Yang, Yuxiang, Yu, Wenhao, Zhang, Tingnan, Tan, Jie, Zhao, Ding
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915184915775488
author Zhang, Yuyou
Yao, Yihang
Liu, Shiqi
Niu, Yaru
Lin, Changyi
Yang, Yuxiang
Yu, Wenhao
Zhang, Tingnan
Tan, Jie
Zhao, Ding
author_facet Zhang, Yuyou
Yao, Yihang
Liu, Shiqi
Niu, Yaru
Lin, Changyi
Yang, Yuxiang
Yu, Wenhao
Zhang, Tingnan
Tan, Jie
Zhao, Ding
contents When operating at their full capacity, quadrupedal robots can produce loud footstep noise, which can be disruptive in human-centered environments like homes, offices, and hospitals. As a result, balancing locomotion performance with noise constraints is crucial for the successful real-world deployment of quadrupedal robots. However, achieving adaptive noise control is challenging due to (a) the trade-off between agility and noise minimization, (b) the need for generalization across diverse deployment conditions, and (c) the difficulty of effectively adjusting policies based on noise requirements. We propose QuietPaw, a framework incorporating our Conditional Noise-Constrained Policy (CNCP), a constrained learning-based algorithm that enables flexible, noise-aware locomotion by conditioning policy behavior on noise-reduction levels. We leverage value representation decomposition in the critics, disentangling state representations from condition-dependent representations and this allows a single versatile policy to generalize across noise levels without retraining while improving the Pareto trade-off between agility and noise reduction. We validate our approach in simulation and the real world, demonstrating that CNCP can effectively balance locomotion performance and noise constraints, achieving continuously adjustable noise reduction.
format Preprint
id arxiv_https___arxiv_org_abs_2503_05035
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle QuietPaw: Learning Quadrupedal Locomotion with Versatile Noise Preference Alignment
Zhang, Yuyou
Yao, Yihang
Liu, Shiqi
Niu, Yaru
Lin, Changyi
Yang, Yuxiang
Yu, Wenhao
Zhang, Tingnan
Tan, Jie
Zhao, Ding
Robotics
Machine Learning
When operating at their full capacity, quadrupedal robots can produce loud footstep noise, which can be disruptive in human-centered environments like homes, offices, and hospitals. As a result, balancing locomotion performance with noise constraints is crucial for the successful real-world deployment of quadrupedal robots. However, achieving adaptive noise control is challenging due to (a) the trade-off between agility and noise minimization, (b) the need for generalization across diverse deployment conditions, and (c) the difficulty of effectively adjusting policies based on noise requirements. We propose QuietPaw, a framework incorporating our Conditional Noise-Constrained Policy (CNCP), a constrained learning-based algorithm that enables flexible, noise-aware locomotion by conditioning policy behavior on noise-reduction levels. We leverage value representation decomposition in the critics, disentangling state representations from condition-dependent representations and this allows a single versatile policy to generalize across noise levels without retraining while improving the Pareto trade-off between agility and noise reduction. We validate our approach in simulation and the real world, demonstrating that CNCP can effectively balance locomotion performance and noise constraints, achieving continuously adjustable noise reduction.
title QuietPaw: Learning Quadrupedal Locomotion with Versatile Noise Preference Alignment
topic Robotics
Machine Learning
url https://arxiv.org/abs/2503.05035