Saved in:
Bibliographic Details
Main Authors: Zhang, Yuhang, Chai, Shuqi, Zhang, Yukang, Yang, Liusha, Zhang, Mingchuan, Wang, Wei, Shi, Qingjiang, Ge, Quanbo
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.26974
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911728215785472
author Zhang, Yuhang
Chai, Shuqi
Zhang, Yukang
Yang, Liusha
Zhang, Mingchuan
Wang, Wei
Shi, Qingjiang
Ge, Quanbo
author_facet Zhang, Yuhang
Chai, Shuqi
Zhang, Yukang
Yang, Liusha
Zhang, Mingchuan
Wang, Wei
Shi, Qingjiang
Ge, Quanbo
contents Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formidable challenge in dynamic maritime environments, particularly when perception systems exhibit miscalibrated uncertainty. Existing Reinforcement Learning (RL)-based methods often falter because state-estimation errors induce unreliable belief states that mislead the value function, while discrete traffic rules introduce discontinuity in the learning objective. To address these challenges, we propose a framework integrating credibility-aware learning, geometric safety shielding, and continuous rule-aware embedding. First, Credibility-Weighted Value Learning (CW-VL) introduces a dynamic trust factor derived from the discrepancy between filter-estimated covariance and empirical error statistics to modulate the critic's heteroscedastic loss, preventing policy overfitting to noisy samples. Second, the Covariance-Inflated Velocity Obstacle (CI-VO) maps position-estimation uncertainty into set-wise angular margins, forming a conservative geometric shield that overrides hazardous exploratory actions. Third, Risk-Aware COLREGs Duty Embedding relaxes binary encounter duties into continuous rule-aware signals, providing smooth sector-transition information and suppressing oscillation from sparse rule rewards. Simulated encounter studies demonstrate improved training robustness against perceptual inconsistency and superior collision avoidance and COLREGs compliance over baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2605_26974
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Trust, Geometry, and Rules: A Credibility-Aware Reinforcement Learning Framework for Safe USV Navigation under Uncertainty
Zhang, Yuhang
Chai, Shuqi
Zhang, Yukang
Yang, Liusha
Zhang, Mingchuan
Wang, Wei
Shi, Qingjiang
Ge, Quanbo
Robotics
Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formidable challenge in dynamic maritime environments, particularly when perception systems exhibit miscalibrated uncertainty. Existing Reinforcement Learning (RL)-based methods often falter because state-estimation errors induce unreliable belief states that mislead the value function, while discrete traffic rules introduce discontinuity in the learning objective. To address these challenges, we propose a framework integrating credibility-aware learning, geometric safety shielding, and continuous rule-aware embedding. First, Credibility-Weighted Value Learning (CW-VL) introduces a dynamic trust factor derived from the discrepancy between filter-estimated covariance and empirical error statistics to modulate the critic's heteroscedastic loss, preventing policy overfitting to noisy samples. Second, the Covariance-Inflated Velocity Obstacle (CI-VO) maps position-estimation uncertainty into set-wise angular margins, forming a conservative geometric shield that overrides hazardous exploratory actions. Third, Risk-Aware COLREGs Duty Embedding relaxes binary encounter duties into continuous rule-aware signals, providing smooth sector-transition information and suppressing oscillation from sparse rule rewards. Simulated encounter studies demonstrate improved training robustness against perceptual inconsistency and superior collision avoidance and COLREGs compliance over baselines.
title Trust, Geometry, and Rules: A Credibility-Aware Reinforcement Learning Framework for Safe USV Navigation under Uncertainty
topic Robotics
url https://arxiv.org/abs/2605.26974