Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911357486497792 |
|---|---|
| author | Hu, Kai Aggarwal, Abhinav Khodabandeh, Mehran Zhang, David Hsin, Eric Chen, Li Jain, Ankit Fredrikson, Matt Bharadwaj, Akash |
| author_facet | Hu, Kai Aggarwal, Abhinav Khodabandeh, Mehran Zhang, David Hsin, Eric Chen, Li Jain, Ankit Fredrikson, Matt Bharadwaj, Akash |
| contents | This paper introduces Jailbreak-Zero, a novel red teaming methodology that shifts the paradigm of Large Language Model (LLM) safety evaluation from a constrained example-based approach to a more expansive and effective policy-based framework. By leveraging an attack LLM to generate a high volume of diverse adversarial prompts and then fine-tuning this attack model with a preference dataset, Jailbreak-Zero achieves Pareto optimality across the crucial objectives of policy coverage, attack strategy diversity, and prompt fidelity to real user inputs. The empirical evidence demonstrates the superiority of this method, showcasing significantly higher attack success rates against both open-source and proprietary models like GPT-40 and Claude 3.5 when compared to existing state-of-the-art techniques. Crucially, Jailbreak-Zero accomplishes this while producing human-readable and effective adversarial prompts with minimal need for human intervention, thereby presenting a more scalable and comprehensive solution for identifying and mitigating the safety vulnerabilities of LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_03265 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models Hu, Kai Aggarwal, Abhinav Khodabandeh, Mehran Zhang, David Hsin, Eric Chen, Li Jain, Ankit Fredrikson, Matt Bharadwaj, Akash Computation and Language Cryptography and Security Machine Learning This paper introduces Jailbreak-Zero, a novel red teaming methodology that shifts the paradigm of Large Language Model (LLM) safety evaluation from a constrained example-based approach to a more expansive and effective policy-based framework. By leveraging an attack LLM to generate a high volume of diverse adversarial prompts and then fine-tuning this attack model with a preference dataset, Jailbreak-Zero achieves Pareto optimality across the crucial objectives of policy coverage, attack strategy diversity, and prompt fidelity to real user inputs. The empirical evidence demonstrates the superiority of this method, showcasing significantly higher attack success rates against both open-source and proprietary models like GPT-40 and Claude 3.5 when compared to existing state-of-the-art techniques. Crucially, Jailbreak-Zero accomplishes this while producing human-readable and effective adversarial prompts with minimal need for human intervention, thereby presenting a more scalable and comprehensive solution for identifying and mitigating the safety vulnerabilities of LLMs. |
| title | Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models |
| topic | Computation and Language Cryptography and Security Machine Learning |
| url | https://arxiv.org/abs/2601.03265 |