LLM-Agnostic Semantic Representation Attack

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lian, Jiawei, Pan, Jianhong, Wang, Lefan, Wang, Yi, Huang, Tairan, Mei, Shaohui, Chau, Lap-Pui
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914547876495360
author Lian, Jiawei
Pan, Jianhong
Wang, Lefan
Wang, Yi
Huang, Tairan
Mei, Shaohui
Chau, Lap-Pui
author_facet Lian, Jiawei
Pan, Jianhong
Wang, Lefan
Wang, Yi
Huang, Tairan
Mei, Shaohui
Chau, Lap-Pui
contents Large Language Models (LLMs) increasingly employ alignment techniques to prevent harmful outputs. Despite these safeguards, attackers can circumvent them by crafting adversarial prompts. Predominant token-level optimization methods primarily rely on optimizing for exact affirmative templates (e.g., ``\textit{Sure, here is...}''). However, these paradigms frequently encounter bottlenecks such as suboptimal convergence, compromised prompt naturalness, and poor cross-model generalization. To address these limitations, we propose Semantic Representation Attack (SRA), a novel LLM-agnostic paradigm that fundamentally reconceptualizes adversarial objectives from exact textual targeting to malicious semantic representations. Theoretically, we establish the semantic Coherence-Convergence Relationship and derive a Cross-Model Semantic Generalization bound, proving that maintaining semantic coherence guarantees both white-box semantic convergence and black-box transferability. Technically, we operationalize this framework via the Semantic Representation Heuristic Search (SRHS) algorithm, which preserves interpretability and structural coherence of the adversarial prompts during incremental discrete token chunk expansion. Extensive evaluations demonstrate that our framework achieves a 99.71% average attack success rate across 26 open-source LLMs, with strong transferability and stealth.
format Preprint
id arxiv_https___arxiv_org_abs_2605_08898
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LLM-Agnostic Semantic Representation Attack
Lian, Jiawei
Pan, Jianhong
Wang, Lefan
Wang, Yi
Huang, Tairan
Mei, Shaohui
Chau, Lap-Pui
Computation and Language
Artificial Intelligence
Large Language Models (LLMs) increasingly employ alignment techniques to prevent harmful outputs. Despite these safeguards, attackers can circumvent them by crafting adversarial prompts. Predominant token-level optimization methods primarily rely on optimizing for exact affirmative templates (e.g., ``\textit{Sure, here is...}''). However, these paradigms frequently encounter bottlenecks such as suboptimal convergence, compromised prompt naturalness, and poor cross-model generalization. To address these limitations, we propose Semantic Representation Attack (SRA), a novel LLM-agnostic paradigm that fundamentally reconceptualizes adversarial objectives from exact textual targeting to malicious semantic representations. Theoretically, we establish the semantic Coherence-Convergence Relationship and derive a Cross-Model Semantic Generalization bound, proving that maintaining semantic coherence guarantees both white-box semantic convergence and black-box transferability. Technically, we operationalize this framework via the Semantic Representation Heuristic Search (SRHS) algorithm, which preserves interpretability and structural coherence of the adversarial prompts during incremental discrete token chunk expansion. Extensive evaluations demonstrate that our framework achieves a 99.71% average attack success rate across 26 open-source LLMs, with strong transferability and stealth.
title LLM-Agnostic Semantic Representation Attack
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2605.08898