Saved in:
Bibliographic Details
Main Authors: Bissey, Brett, Gatesman, Kyle, Dimon, Walker, Alam, Mohammad, Robaina, Luis, Weissman, Joseph
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.21414
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915307719753728
author Bissey, Brett
Gatesman, Kyle
Dimon, Walker
Alam, Mohammad
Robaina, Luis
Weissman, Joseph
author_facet Bissey, Brett
Gatesman, Kyle
Dimon, Walker
Alam, Mohammad
Robaina, Luis
Weissman, Joseph
contents This paper introduces a comprehensive framework designed to analyze and secure decision-support systems trained with Deep Reinforcement Learning (DRL), prior to deployment, by providing insights into learned behavior patterns and vulnerabilities discovered through simulation. The introduced framework aids in the development of precisely timed and targeted observation perturbations, enabling researchers to assess adversarial attack outcomes within a strategic decision-making context. We validate our framework, visualize agent behavior, and evaluate adversarial outcomes within the context of a custom-built strategic game, CyberStrike. Utilizing the proposed framework, we introduce a method for systematically discovering and ranking the impact of attacks on various observation indices and time-steps, and we conduct experiments to evaluate the transferability of adversarial attacks across agent architectures and DRL training algorithms. The findings underscore the critical need for robust adversarial defense mechanisms to protect decision-making policies in high-stakes environments.
format Preprint
id arxiv_https___arxiv_org_abs_2505_21414
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Framework for Adversarial Analysis of Decision Support Systems Prior to Deployment
Bissey, Brett
Gatesman, Kyle
Dimon, Walker
Alam, Mohammad
Robaina, Luis
Weissman, Joseph
Machine Learning
Artificial Intelligence
Computer Science and Game Theory
This paper introduces a comprehensive framework designed to analyze and secure decision-support systems trained with Deep Reinforcement Learning (DRL), prior to deployment, by providing insights into learned behavior patterns and vulnerabilities discovered through simulation. The introduced framework aids in the development of precisely timed and targeted observation perturbations, enabling researchers to assess adversarial attack outcomes within a strategic decision-making context. We validate our framework, visualize agent behavior, and evaluate adversarial outcomes within the context of a custom-built strategic game, CyberStrike. Utilizing the proposed framework, we introduce a method for systematically discovering and ranking the impact of attacks on various observation indices and time-steps, and we conduct experiments to evaluate the transferability of adversarial attacks across agent architectures and DRL training algorithms. The findings underscore the critical need for robust adversarial defense mechanisms to protect decision-making policies in high-stakes environments.
title A Framework for Adversarial Analysis of Decision Support Systems Prior to Deployment
topic Machine Learning
Artificial Intelligence
Computer Science and Game Theory
url https://arxiv.org/abs/2505.21414