ERIS: Evolutionary Real-world Interference Scheme for Jailbreaking Audio Large Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Yibo, Lin, Liang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908859598110720
author Zhang, Yibo
Lin, Liang
author_facet Zhang, Yibo
Lin, Liang
contents Existing Audio Large Models (ALMs) alignment focuses on clean inputs, neglecting security risks in complex environments. We propose ERIS, a framework transforming real-world interference into a strategically optimized carrier for jailbreaking ALMs. Unlike methods relying on manually designed acoustic patterns, ERIS uses a genetic algorithm to optimize the selection and synthesis of naturalistic signals. Through population initialization, crossover fusion, and probabilistic mutation, it evolves audio fusing malicious instructions with real-world interference. To humans and safety filters, these samples present as natural speech with harmless background noise, yet bypass alignment. Evaluations on multiple ALMs show ERIS significantly outperforms both text and audio jailbreak baselines. Our findings reveal that seemingly innocuous real-world interference can be leveraged to circumvent safety constraints, providing new insights for defensive mechanisms in complex acoustic scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2509_11128
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ERIS: Evolutionary Real-world Interference Scheme for Jailbreaking Audio Large Models
Zhang, Yibo
Lin, Liang
Sound
Artificial Intelligence
Existing Audio Large Models (ALMs) alignment focuses on clean inputs, neglecting security risks in complex environments. We propose ERIS, a framework transforming real-world interference into a strategically optimized carrier for jailbreaking ALMs. Unlike methods relying on manually designed acoustic patterns, ERIS uses a genetic algorithm to optimize the selection and synthesis of naturalistic signals. Through population initialization, crossover fusion, and probabilistic mutation, it evolves audio fusing malicious instructions with real-world interference. To humans and safety filters, these samples present as natural speech with harmless background noise, yet bypass alignment. Evaluations on multiple ALMs show ERIS significantly outperforms both text and audio jailbreak baselines. Our findings reveal that seemingly innocuous real-world interference can be leveraged to circumvent safety constraints, providing new insights for defensive mechanisms in complex acoustic scenarios.
title ERIS: Evolutionary Real-world Interference Scheme for Jailbreaking Audio Large Models
topic Sound
Artificial Intelligence
url https://arxiv.org/abs/2509.11128