Cover Image

Evolution-based Region Adversarial Prompt Learning for Robustness Enhancement in Vision-Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jia, Xiaojun, Gao, Sensen, Qin, Simeng, Ma, Ke, Li, Xinfeng, Huang, Yihao, Dong, Wei, Liu, Yang, Cao, Xiaochun
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Semantic-Aligned Adversarial Evolution Triangle for High-Transferability Vision-Language Attack
by: Jia, Xiaojun, et al.
Published: (2024)

GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations
by: Liu, Xinwei, et al.
Published: (2025)

Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignment
by: Jia, Xiaojun, et al.
Published: (2025)

Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectory
by: Gao, Sensen, et al.
Published: (2024)

SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agents
by: Jia, Xiaojun, et al.
Published: (2026)

PromptGuard: Soft Prompt-Guided Unsafe Content Moderation for Text-to-Image Models
by: Yuan, Lingzhi, et al.
Published: (2025)

PATFinger: Prompt-Adapted Transferable Fingerprinting against Unauthorized Multimodal Dataset Usage
by: Zhang, Wenyi, et al.
Published: (2025)

The Eye of Sherlock Holmes: Uncovering User Private Attribute Profiling via Vision-Language Model Agentic Framework
by: Liu, Feiran, et al.
Published: (2025)

SGHA-Attack: Semantic-Guided Hierarchical Alignment for Transferable Targeted Attacks on Vision-Language Models
by: Wang, Haobo, et al.
Published: (2026)

Texture Re-scalable Universal Adversarial Perturbation
by: Huang, Yihao, et al.
Published: (2024)

Inverse Reinforcement Learning with Dynamic Reward Scaling for LLM Alignment
by: Cheng, Ruoxi, et al.
Published: (2025)

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems
by: Guo, Qi, et al.
Published: (2025)

Heuristic-Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models
by: Teng, Ma, et al.
Published: (2024)

Reasoning as an Attack Surface: Adaptive Evolutionary CoT Jailbreaks for LLMs
by: Li, Jianan, et al.
Published: (2026)

3D Gaussian Splatting Driven Multi-View Robust Physical Adversarial Camouflage Generation
by: Lou, Tianrui, et al.
Published: (2025)

Improved Techniques for Optimization-Based Jailbreaking on Large Language Models
by: Jia, Xiaojun, et al.
Published: (2024)

Shedding Light on VLN Robustness: A Black-box Framework for Indoor Lighting-based Adversarial Attack
by: Li, Chenyang, et al.
Published: (2025)

ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference
by: Ma, Siyuan, et al.
Published: (2026)

HTS-Attack: Heuristic Token Search for Jailbreaking Text-to-Image Models
by: Gao, Sensen, et al.
Published: (2024)

Robust Anti-Backdoor Instruction Tuning in LVLMs
by: Xun, Yuan, et al.
Published: (2025)

Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Search
by: Huang, Xun, et al.
Published: (2026)

OmniSafeBench-MM: A Unified Benchmark and Toolbox for Multimodal Jailbreak Attack-Defense Evaluation
by: Jia, Xiaojun, et al.
Published: (2025)

TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models
by: Wang, Xin, et al.
Published: (2024)

Adversarial Prompt Distillation for Vision-Language Models
by: Luo, Lin, et al.
Published: (2024)

NAP-Tuning: Neural Augmented Prompt Tuning for Adversarially Robust Vision-Language Models
by: Zhang, Jiaming, et al.
Published: (2025)

Adversarial Prompt Tuning for Vision-Language Models
by: Zhang, Jiaming, et al.
Published: (2023)

RESTORE: Towards Feature Shift for Vision-Language Prompt Learning
by: Yang, Yuncheng, et al.
Published: (2024)

Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Models
by: Liu, Xiao, et al.
Published: (2026)

Multimodal Unlearnable Examples: Protecting Data against Multimodal Contrastive Learning
by: Liu, Xinwei, et al.
Published: (2024)

Hide in Thicket: Generating Imperceptible and Rational Adversarial Perturbations on 3D Point Clouds
by: Lou, Tianrui, et al.
Published: (2024)

CleanerCLIP: Fine-grained Counterfactual Semantic Augmentation for Backdoor Defense in Contrastive Learning
by: Xun, Yuan, et al.
Published: (2024)

R-PGA: Robust Physical Adversarial Camouflage Generation via Relightable 3D Gaussian Splatting
by: Lou, Tianrui, et al.
Published: (2026)

PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
by: Zhu, Kaijie, et al.
Published: (2023)

Differentiable Prompt Learning for Vision Language Models
by: Huang, Zhenhan, et al.
Published: (2024)

JailGuard: A Universal Detection Framework for LLM Prompt-based Attacks
by: Zhang, Xiaoyu, et al.
Published: (2023)

Few-Shot Adversarial Prompt Learning on Vision-Language Models
by: Zhou, Yiwei, et al.
Published: (2024)

Robust SAM: On the Adversarial Robustness of Vision Foundation Models
by: Long, Jiahuan, et al.
Published: (2025)

SeCon-RAG: A Two-Stage Semantic Filtering and Conflict-Free Framework for Trustworthy RAG
by: Si, Xiaonan, et al.
Published: (2025)

Modular Prompt Learning Improves Vision-Language Models
by: Huang, Zhenhan, et al.
Published: (2025)

FedAPT: Federated Adversarial Prompt Tuning for Vision-Language Models
by: Zhai, Kun, et al.
Published: (2025)