From Adversarial Poetry to Adversarial Tales: An Interpretability Research Agenda
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911379969015808 |
|---|---|
| author | Bisconti, Piercosma Galisai, Marcello Prandi, Matteo Pierucci, Federico Sorokoletova, Olga Giarrusso, Francesco Suriani, Vincenzo Syrnikov, Marcantonio Bracale Nardi, Daniele |
| author_facet | Bisconti, Piercosma Galisai, Marcello Prandi, Matteo Pierucci, Federico Sorokoletova, Olga Giarrusso, Francesco Suriani, Vincenzo Syrnikov, Marcantonio Bracale Nardi, Daniele |
| contents | Safety mechanisms in LLMs remain vulnerable to attacks that reframe harmful requests through culturally coded structures. We introduce Adversarial Tales, a jailbreak technique that embeds harmful content within cyberpunk narratives and prompts models to perform functional analysis inspired by Vladimir Propp's morphology of folktales. By casting the task as structural decomposition, the attack induces models to reconstruct harmful procedures as legitimate narrative interpretation. Across 26 frontier models from nine providers, we observe an average attack success rate of 71.3%, with no model family proving reliably robust. Together with our prior work on Adversarial Poetry, these findings suggest that structurally-grounded jailbreaks constitute a broad vulnerability class rather than isolated techniques. The space of culturally coded frames that can mediate harmful intent is vast, likely inexhaustible by pattern-matching defenses alone. Understanding why these attacks succeed is therefore essential: we outline a mechanistic interpretability research agenda to investigate how narrative cues reshape model representations and whether models can learn to recognize harmful intent independently of surface form. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_08837 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From Adversarial Poetry to Adversarial Tales: An Interpretability Research Agenda Bisconti, Piercosma Galisai, Marcello Prandi, Matteo Pierucci, Federico Sorokoletova, Olga Giarrusso, Francesco Suriani, Vincenzo Syrnikov, Marcantonio Bracale Nardi, Daniele Computation and Language Artificial Intelligence Computers and Society Machine Learning Safety mechanisms in LLMs remain vulnerable to attacks that reframe harmful requests through culturally coded structures. We introduce Adversarial Tales, a jailbreak technique that embeds harmful content within cyberpunk narratives and prompts models to perform functional analysis inspired by Vladimir Propp's morphology of folktales. By casting the task as structural decomposition, the attack induces models to reconstruct harmful procedures as legitimate narrative interpretation. Across 26 frontier models from nine providers, we observe an average attack success rate of 71.3%, with no model family proving reliably robust. Together with our prior work on Adversarial Poetry, these findings suggest that structurally-grounded jailbreaks constitute a broad vulnerability class rather than isolated techniques. The space of culturally coded frames that can mediate harmful intent is vast, likely inexhaustible by pattern-matching defenses alone. Understanding why these attacks succeed is therefore essential: we outline a mechanistic interpretability research agenda to investigate how narrative cues reshape model representations and whether models can learn to recognize harmful intent independently of surface form. |
| title | From Adversarial Poetry to Adversarial Tales: An Interpretability Research Agenda |
| topic | Computation and Language Artificial Intelligence Computers and Society Machine Learning |
| url | https://arxiv.org/abs/2601.08837 |