Saved in:
Bibliographic Details
Main Authors: Xiaocai, Zhang, Zhe, Xiao, Maohan, Liang, Tao, Liu, Haijiang, Li, Wenbin, Zhang
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.10911
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908769522286592
author Xiaocai, Zhang
Zhe, Xiao
Maohan, Liang
Tao, Liu
Haijiang, Li
Wenbin, Zhang
author_facet Xiaocai, Zhang
Zhe, Xiao
Maohan, Liang
Tao, Liu
Haijiang, Li
Wenbin, Zhang
contents Sustainability is becoming increasingly critical in the maritime transport, encompassing both environmental and social impacts, such as Greenhouse Gas (GHG) emissions and navigational safety. Traditional vessel navigation heavily relies on human experience, often lacking autonomy and emission awareness, and is prone to human errors that may compromise safety. In this paper, we propose a Curriculum Reinforcement Learning (CRL) framework integrated with a realistic, data-driven marine simulation environment and a machine learning-based fuel consumption prediction module. The simulation environment is constructed using real-world vessel movement data and enhanced with a Diffusion Model to simulate dynamic maritime conditions. Vessel fuel consumption is estimated using historical operational data and learning-based regression. The surrounding environment is represented as image-based inputs to capture spatial complexity. We design a lightweight, policy-based CRL agent with a comprehensive reward mechanism that considers safety, emissions, timeliness, and goal completion. This framework effectively handles complex tasks progressively while ensuring stable and efficient learning in continuous action spaces. We validate the proposed approach in a sea area of the Indian Ocean, demonstrating its efficacy in enabling sustainable and safe vessel navigation.
format Preprint
id arxiv_https___arxiv_org_abs_2601_10911
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation
Xiaocai, Zhang
Zhe, Xiao
Maohan, Liang
Tao, Liu
Haijiang, Li
Wenbin, Zhang
Machine Learning
Sustainability is becoming increasingly critical in the maritime transport, encompassing both environmental and social impacts, such as Greenhouse Gas (GHG) emissions and navigational safety. Traditional vessel navigation heavily relies on human experience, often lacking autonomy and emission awareness, and is prone to human errors that may compromise safety. In this paper, we propose a Curriculum Reinforcement Learning (CRL) framework integrated with a realistic, data-driven marine simulation environment and a machine learning-based fuel consumption prediction module. The simulation environment is constructed using real-world vessel movement data and enhanced with a Diffusion Model to simulate dynamic maritime conditions. Vessel fuel consumption is estimated using historical operational data and learning-based regression. The surrounding environment is represented as image-based inputs to capture spatial complexity. We design a lightweight, policy-based CRL agent with a comprehensive reward mechanism that considers safety, emissions, timeliness, and goal completion. This framework effectively handles complex tasks progressively while ensuring stable and efficient learning in continuous action spaces. We validate the proposed approach in a sea area of the Indian Ocean, demonstrating its efficacy in enabling sustainable and safe vessel navigation.
title Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation
topic Machine Learning
url https://arxiv.org/abs/2601.10911