Cover Image

AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defenses

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Carlini, Nicholas, Rando, Javier, Debenedetti, Edoardo, Nasr, Milad, Tramèr, Florian
Format:	Preprint
Published:	2025
Subjects:	Cryptography and Security Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLMs unlock new paths to monetizing exploits
by: Carlini, Nicholas, et al.
Published: (2025)

Evading Black-box Classifiers Without Breaking Eggs
by: Debenedetti, Edoardo, et al.
Published: (2023)

Query-Based Adversarial Prompt Generation
by: Hayase, Jonathan, et al.
Published: (2024)

Universal Jailbreak Backdoors from Poisoned Human Feedback
by: Rando, Javier, et al.
Published: (2023)

Defeating Prompt Injections by Design
by: Debenedetti, Edoardo, et al.
Published: (2025)

Are aligned neural networks adversarially aligned?
by: Carlini, Nicholas, et al.
Published: (2023)

Persistent Pre-Training Poisoning of LLMs
by: Zhang, Yiming, et al.
Published: (2024)

Adversarial Perturbations Cannot Reliably Protect Artists From Generative AI
by: Hönig, Robert, et al.
Published: (2024)

Privacy Side Channels in Machine Learning Systems
by: Debenedetti, Edoardo, et al.
Published: (2023)

Gradient-based Jailbreak Images for Multimodal Fusion Models
by: Rando, Javier, et al.
Published: (2024)

Cutting through buggy adversarial example defenses: fixing 1 line of code breaks Sabre
by: Carlini, Nicholas
Published: (2024)

Adversarial ML Problems Are Getting Harder to Solve and to Evaluate
by: Rando, Javier, et al.
Published: (2025)

Adversarial Search Engine Optimization for Large Language Models
by: Nestaas, Fredrik, et al.
Published: (2024)

Remote Timing Attacks on Efficient Language Model Inference
by: Carlini, Nicholas, et al.
Published: (2024)

Large-scale online deanonymization with LLMs
by: Lermen, Simon, et al.
Published: (2026)

SoK: Watermarking for AI-Generated Content
by: Zhao, Xuandong, et al.
Published: (2024)

An Adversarial Perspective on Machine Unlearning for AI Safety
by: Łucki, Jakub, et al.
Published: (2024)

AutoPenBench: Benchmarking Generative Agents for Penetration Testing
by: Gioacchini, Luca, et al.
Published: (2024)

On Evaluating the Durability of Safeguards for Open-Weight LLMs
by: Qi, Xiangyu, et al.
Published: (2024)

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition
by: Debenedetti, Edoardo, et al.
Published: (2024)

Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
by: Tramèr, Florian, et al.
Published: (2022)

Competition Report: Finding Universal Jailbreak Backdoors in Aligned LLMs
by: Rando, Javier, et al.
Published: (2024)

Can Reasoning Models Obfuscate Reasoning? Stress-Testing Chain-of-Thought Monitorability
by: Zolkowski, Artur, et al.
Published: (2025)

Detecting Adversarial Fine-tuning with Auditing Agents
by: Egler, Sarah, et al.
Published: (2025)

JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models
by: Chao, Patrick, et al.
Published: (2024)

SoK: Systematic analysis of adversarial threats against deep learning approaches for autonomous anomaly detection systems in SDN-IoT networks
by: Yasarathna, Tharindu Lakshan, et al.
Published: (2025)

The Jailbreak Tax: How Useful are Your Jailbreak Outputs?
by: Nikolić, Kristina, et al.
Published: (2025)

Trojan Hippo: Weaponizing Agent Memory for Data Exfiltration
by: Das, Debeshee, et al.
Published: (2026)

AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
by: Debenedetti, Edoardo, et al.
Published: (2024)

AttackSeqBench: Benchmarking the Capabilities of LLMs for Attack Sequences Understanding
by: Ma, Haokai, et al.
Published: (2025)

RAB$^2$-DEF: Dynamic and explainable defense against adversarial attacks in Federated Learning to fair poor clients
by: Rodríguez-Barroso, Nuria, et al.
Published: (2024)

Towards Explainable and Lightweight AI for Real-Time Cyber Threat Hunting in Edge Networks
by: Rahmati, Milad
Published: (2025)

GEO-Bench: Benchmarking Ranking Manipulation in Generative Engine Optimization
by: Nimase, Ojas, et al.
Published: (2026)

Attacks on the neural network and defense methods
by: Korenev, A., et al.
Published: (2024)

Polynomial Time Cryptanalytic Extraction of Deep Neural Networks in the Hard-Label Setting
by: Carlini, Nicholas, et al.
Published: (2024)

ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents
by: Lee, Seunghyun, et al.
Published: (2026)

SLEIGHT-Bench: A Benchmark of Evasion Attacks Against Agent Monitors
by: Najt, Elle, et al.
Published: (2026)

DPImageBench: A Unified Benchmark for Differentially Private Image Synthesis
by: Gong, Chen, et al.
Published: (2025)

Privacy Auditing of Large Language Models
by: Panda, Ashwinee, et al.
Published: (2025)

ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models
by: Liu, Xuxu, et al.
Published: (2025)