The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models?
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912214046212096 |
|---|---|
| author | Kao, Ching-Chia Yu, Chia-Mu Lu, Chun-Shien Chen, Chu-Song |
| author_facet | Kao, Ching-Chia Yu, Chia-Mu Lu, Chun-Shien Chen, Chu-Song |
| contents | Vision-Language Models (VLMs) have achieved remarkable performance on a variety of tasks, yet they remain vulnerable to jailbreak attacks that compromise safety and reliability. In this paper, we provide an information-theoretic framework for understanding the fundamental trade-off between the effectiveness of these attacks and their stealthiness. Drawing on Fano's inequality, we demonstrate how an attacker's success probability is intrinsically linked to the stealthiness of generated prompts. Building on this, we propose an efficient algorithm for detecting non-stealthy jailbreak attacks, offering significant improvements in model robustness. Experimental results highlight the tension between strong attacks and their detectability, providing insights into both adversarial strategies and defense mechanisms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_01438 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models? Kao, Ching-Chia Yu, Chia-Mu Lu, Chun-Shien Chen, Chu-Song Machine Learning Vision-Language Models (VLMs) have achieved remarkable performance on a variety of tasks, yet they remain vulnerable to jailbreak attacks that compromise safety and reliability. In this paper, we provide an information-theoretic framework for understanding the fundamental trade-off between the effectiveness of these attacks and their stealthiness. Drawing on Fano's inequality, we demonstrate how an attacker's success probability is intrinsically linked to the stealthiness of generated prompts. Building on this, we propose an efficient algorithm for detecting non-stealthy jailbreak attacks, offering significant improvements in model robustness. Experimental results highlight the tension between strong attacks and their detectability, providing insights into both adversarial strategies and defense mechanisms. |
| title | The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models? |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2410.01438 |