Learning to Communicate in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Contractor, Faizan, Li, Li, Mallah, Ranwa Al
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916852175732736
author Contractor, Faizan
Li, Li
Mallah, Ranwa Al
author_facet Contractor, Faizan
Li, Li
Mallah, Ranwa Al
contents Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However, by sharing information such as known or suspected ongoing threats, effective communication can lead to improved decision-making in the cyber battle space. We propose a game design where defender agents learn to communicate and defend against imminent cyber threats by playing training games in the Cyber Operations Research Gym, using the Differentiable Inter Agent Learning algorithm adapted to the cyber operational environment. The tactical policies learned by these autonomous agents are akin to those of human experts during incident responses to avert cyber threats. In addition, the agents simultaneously learn minimal cost communication messages while learning their defence tactical policies.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14658
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning to Communicate in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence
Contractor, Faizan
Li, Li
Mallah, Ranwa Al
Multiagent Systems
Cryptography and Security
Machine Learning
Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However, by sharing information such as known or suspected ongoing threats, effective communication can lead to improved decision-making in the cyber battle space. We propose a game design where defender agents learn to communicate and defend against imminent cyber threats by playing training games in the Cyber Operations Research Gym, using the Differentiable Inter Agent Learning algorithm adapted to the cyber operational environment. The tactical policies learned by these autonomous agents are akin to those of human experts during incident responses to avert cyber threats. In addition, the agents simultaneously learn minimal cost communication messages while learning their defence tactical policies.
title Learning to Communicate in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence
topic Multiagent Systems
Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2507.14658