WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cao, Tri, Chen, Yulin, Cao, Hieu, Li, Yibo, Le, Khoi, Nguyen, Thong, Li, Yuexin, He, Yufei, Liu, Yue, Yan, Shuicheng, Hooi, Bryan
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918501755650048
author Cao, Tri
Chen, Yulin
Cao, Hieu
Li, Yibo
Le, Khoi
Nguyen, Thong
Li, Yuexin
He, Yufei
Liu, Yue
Yan, Shuicheng
Hooi, Bryan
author_facet Cao, Tri
Chen, Yulin
Cao, Hieu
Li, Yibo
Le, Khoi
Nguyen, Thong
Li, Yuexin
He, Yufei
Liu, Yue
Yan, Shuicheng
Hooi, Bryan
contents Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web Agent Robust Defense against Prompt Injection), a practical guard model for secure and efficient web agents. WARD is built on WARD-Base, a large-scale dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated dataset designed for prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive adversarial attack training framework that iteratively strengthens WARD through a memory-based attacker and guard co-evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution benchmarks, maintains low false positive rates to preserve agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the agent without introducing additional latency.
format Preprint
id arxiv_https___arxiv_org_abs_2605_15030
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
Cao, Tri
Chen, Yulin
Cao, Hieu
Li, Yibo
Le, Khoi
Nguyen, Thong
Li, Yuexin
He, Yufei
Liu, Yue
Yan, Shuicheng
Hooi, Bryan
Cryptography and Security
Artificial Intelligence
Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web Agent Robust Defense against Prompt Injection), a practical guard model for secure and efficient web agents. WARD is built on WARD-Base, a large-scale dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated dataset designed for prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive adversarial attack training framework that iteratively strengthens WARD through a memory-based attacker and guard co-evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution benchmarks, maintains low false positive rates to preserve agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the agent without introducing additional latency.
title WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
topic Cryptography and Security
Artificial Intelligence
url https://arxiv.org/abs/2605.15030