Sim2Act: Robust Simulation-to-Decision Learning via Adversarial Calibration and Group-Relative Perturbation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cao, Hongyu, Zhang, Jinghan, Liu, Kunpeng, Wang, Dongjie, Xia, Feng, Chen, Haifeng, Hu, Xiaohua, Fu, Yanjie
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917327925149696
author Cao, Hongyu
Zhang, Jinghan
Liu, Kunpeng
Wang, Dongjie
Xia, Feng
Chen, Haifeng
Hu, Xiaohua
Fu, Yanjie
author_facet Cao, Hongyu
Zhang, Jinghan
Liu, Kunpeng
Wang, Dongjie
Xia, Feng
Chen, Haifeng
Hu, Xiaohua
Fu, Yanjie
contents Simulation-to-decision learning enables safe policy training in digital environments without risking real-world deployment, and has become essential in mission-critical domains such as supply chains and industrial systems. However, simulators learned from noisy or biased real-world data often exhibit prediction errors in decision-critical regions, leading to unstable action ranking and unreliable policies. Existing approaches either focus on improving average simulation fidelity or adopt conservative regularization, which may cause policy collapse by discarding high-risk high-reward actions. We propose Sim2Act, a robust simulation-to-decision framework that addresses both simulator and policy robustness. First, we introduce an adversarial calibration mechanism that re-weights simulation errors in decision-critical state-action pairs to align surrogate fidelity with downstream decision impact. Second, we develop a group-relative perturbation strategy that stabilizes policy learning under simulator uncertainty without enforcing overly pessimistic constraints. Extensive experiments on multiple supply chain benchmarks demonstrate improved simulation robustness and more stable decision performance under structured and unstructured perturbations.
format Preprint
id arxiv_https___arxiv_org_abs_2603_09053
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Sim2Act: Robust Simulation-to-Decision Learning via Adversarial Calibration and Group-Relative Perturbation
Cao, Hongyu
Zhang, Jinghan
Liu, Kunpeng
Wang, Dongjie
Xia, Feng
Chen, Haifeng
Hu, Xiaohua
Fu, Yanjie
Machine Learning
Artificial Intelligence
Simulation-to-decision learning enables safe policy training in digital environments without risking real-world deployment, and has become essential in mission-critical domains such as supply chains and industrial systems. However, simulators learned from noisy or biased real-world data often exhibit prediction errors in decision-critical regions, leading to unstable action ranking and unreliable policies. Existing approaches either focus on improving average simulation fidelity or adopt conservative regularization, which may cause policy collapse by discarding high-risk high-reward actions. We propose Sim2Act, a robust simulation-to-decision framework that addresses both simulator and policy robustness. First, we introduce an adversarial calibration mechanism that re-weights simulation errors in decision-critical state-action pairs to align surrogate fidelity with downstream decision impact. Second, we develop a group-relative perturbation strategy that stabilizes policy learning under simulator uncertainty without enforcing overly pessimistic constraints. Extensive experiments on multiple supply chain benchmarks demonstrate improved simulation robustness and more stable decision performance under structured and unstructured perturbations.
title Sim2Act: Robust Simulation-to-Decision Learning via Adversarial Calibration and Group-Relative Perturbation
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2603.09053