Sequence Aware SAC Control for Engine Fuel Consumption Optimization in Electrified Powertrain

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Jaleel, Wafeeq, Rownak, Md Ragib, Hanif, Athar, Bhatti, Sidra Ghayour, Ahmed, Qadeer
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911095318380544
author Jaleel, Wafeeq
Rownak, Md Ragib
Hanif, Athar
Bhatti, Sidra Ghayour
Ahmed, Qadeer
author_facet Jaleel, Wafeeq
Rownak, Md Ragib
Hanif, Athar
Bhatti, Sidra Ghayour
Ahmed, Qadeer
contents As hybrid electric vehicles (HEVs) gain traction in heavy-duty trucks, adaptive and efficient energy management is critical for reducing fuel consumption while maintaining battery charge for long operation times. We present a new reinforcement learning (RL) framework based on the Soft Actor-Critic (SAC) algorithm to optimize engine control in series HEVs. We reformulate the control task as a sequential decision-making problem and enhance SAC by incorporating Gated Recurrent Units (GRUs) and Decision Transformers (DTs) into both actor and critic networks to capture temporal dependencies and improve planning over time. To evaluate robustness and generalization, we train the models under diverse initial battery states, drive cycle durations, power demands, and input sequence lengths. Experiments show that the SAC agent with a DT-based actor and GRU-based critic was within 1.8% of Dynamic Programming (DP) in fuel savings on the Highway Fuel Economy Test (HFET) cycle, while the SAC agent with GRUs in both actor and critic networks, and FFN actor-critic agent were within 3.16% and 3.43%, respectively. On unseen drive cycles (US06 and Heavy Heavy-Duty Diesel Truck (HHDDT) cruise segment), generalized sequence-aware agents consistently outperformed feedforward network (FFN)-based agents, highlighting their adaptability and robustness in real-world settings.
format Preprint
id arxiv_https___arxiv_org_abs_2508_04874
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sequence Aware SAC Control for Engine Fuel Consumption Optimization in Electrified Powertrain
Jaleel, Wafeeq
Rownak, Md Ragib
Hanif, Athar
Bhatti, Sidra Ghayour
Ahmed, Qadeer
Systems and Control
Artificial Intelligence
Machine Learning
As hybrid electric vehicles (HEVs) gain traction in heavy-duty trucks, adaptive and efficient energy management is critical for reducing fuel consumption while maintaining battery charge for long operation times. We present a new reinforcement learning (RL) framework based on the Soft Actor-Critic (SAC) algorithm to optimize engine control in series HEVs. We reformulate the control task as a sequential decision-making problem and enhance SAC by incorporating Gated Recurrent Units (GRUs) and Decision Transformers (DTs) into both actor and critic networks to capture temporal dependencies and improve planning over time. To evaluate robustness and generalization, we train the models under diverse initial battery states, drive cycle durations, power demands, and input sequence lengths. Experiments show that the SAC agent with a DT-based actor and GRU-based critic was within 1.8% of Dynamic Programming (DP) in fuel savings on the Highway Fuel Economy Test (HFET) cycle, while the SAC agent with GRUs in both actor and critic networks, and FFN actor-critic agent were within 3.16% and 3.43%, respectively. On unseen drive cycles (US06 and Heavy Heavy-Duty Diesel Truck (HHDDT) cruise segment), generalized sequence-aware agents consistently outperformed feedforward network (FFN)-based agents, highlighting their adaptability and robustness in real-world settings.
title Sequence Aware SAC Control for Engine Fuel Consumption Optimization in Electrified Powertrain
topic Systems and Control
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2508.04874