Cover Image

MoAPT: Mixture of Adversarial Prompt Tuning for Vision-Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Shiji, Zhu, Qihui, Xiong, Shukun, Ruan, Shouwei, Yuan, Maoxun, Tao, Jialing, Liu, Jiexi, Duan, Ranjie, Zhang, Jie, Wei, Xingxing
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Knowledge-Guided Adversarial Training for Infrared Object Detection via Thermal Radiation Modeling
by: Zhao, Shiji, et al.
Published: (2026)

Improving Safety Alignment via Balanced Direct Preference Optimization
by: Zhao, Shiji, et al.
Published: (2026)

Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillation
by: Zhao, Shiji, et al.
Published: (2023)

Jailbreaking Multimodal Large Language Models via Shuffle Inconsistency
by: Zhao, Shiji, et al.
Published: (2025)

VRSA: Jailbreaking Multimodal Large Language Models through Visual Reasoning Sequential Attack
by: Zhao, Shiji, et al.
Published: (2025)

Towards Class-wise Fair Adversarial Training via Anti-Bias Soft Label Distillation
by: Zhao, Shiji, et al.
Published: (2025)

When Lighting Deceives: Exposing Vision-Language Models' Illumination Vulnerability Through Illumination Transformation Attack
by: Liu, Hanqing, et al.
Published: (2025)

NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generation
by: Sun, Yitong, et al.
Published: (2025)

$\mathbf{C}^2$Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detection
by: Yuan, Maoxun, et al.
Published: (2023)

FedAPT: Federated Adversarial Prompt Tuning for Vision-Language Models
by: Zhai, Kun, et al.
Published: (2025)

Mind over Space: Can Multimodal Large Language Models Mentally Navigate?
by: Zhu, Qihui, et al.
Published: (2026)

Strata-Sword: A Hierarchical Safety Evaluation towards LLMs based on Reasoning Complexity of Jailbreak Instructions
by: Zhao, Shiji, et al.
Published: (2025)

Omniview-Tuning: Boosting Viewpoint Invariance of Vision-Language Pre-training Models
by: Ruan, Shouwei, et al.
Published: (2024)

Mirage in the Eyes: Hallucination Attack on Multi-modal Large Language Models with Only Attention Sink
by: Wang, Yining, et al.
Published: (2025)

From reactive to cognitive: brain-inspired spatial intelligence for embodied agents
by: Ruan, Shouwei, et al.
Published: (2025)

Seeing Through the Noise: Improving Infrared Small Target Detection and Segmentation from Noise Suppression Perspective
by: Yuan, Maoxun, et al.
Published: (2025)

The Path to Reconciling Quality and Safety in Text-to-Image Generation: Dataset, Method, and Evaluation
by: Ruan, Shouwei, et al.
Published: (2025)

OODFace: Benchmarking Robustness of Face Recognition under Common Corruptions and Appearance Variations
by: Kang, Caixin, et al.
Published: (2024)

Towards Transferable Targeted 3D Adversarial Attack in the Physical World
by: Huang, Yao, et al.
Published: (2023)

Breaking Self-Attention Failure: Rethinking Query Initialization for Infrared Small Target Detection
by: Liu, Yuteng, et al.
Published: (2026)

Mitigating Accuracy-Robustness Trade-off via Balanced Multi-Teacher Adversarial Distillation
by: Zhao, Shiji, et al.
Published: (2023)

MESA: Improving MoE Safety Alignment via Decentralized Expertise
by: Sun, Yitong, et al.
Published: (2026)

DIFFender: Diffusion-Based Adversarial Defense against Patch Attacks
by: Kang, Caixin, et al.
Published: (2023)

CoAPT: Context Attribute words for Prompt Tuning
by: Lee, Gun, et al.
Published: (2024)

Real-world Adversarial Defense against Patch Attacks based on Diffusion Model
by: Wei, Xingxing, et al.
Published: (2024)

MoPD: Mixture-of-Prompts Distillation for Vision-Language Models
by: Chen, Yang, et al.
Published: (2024)

TAME: Test-Time Adversarial Prompt Tuning via Mixture-of-Experts for Vision-Language Models
by: Wang, Xin, et al.
Published: (2026)

World2Mind: Cognition Toolkit for Allocentric Spatial Reasoning in Foundation Models
by: Ruan, Shouwei, et al.
Published: (2026)

UniRGB-IR: A Unified Framework for Visible-Infrared Semantic Tasks via Adapter Tuning
by: Yuan, Maoxun, et al.
Published: (2024)

Adversarial Prompt Tuning for Vision-Language Models
by: Zhang, Jiaming, et al.
Published: (2023)

Removal then Selection: A Coarse-to-Fine Fusion Perspective for RGB-Infrared Object Detection
by: Zhao, Tianyi, et al.
Published: (2024)

Breaking the Ceiling: Exploring the Potential of Jailbreak Attacks through Expanding Strategy Space
by: Huang, Yao, et al.
Published: (2025)

Mitigating Overthinking in Large Reasoning Models via Manifold Steering
by: Huang, Yao, et al.
Published: (2025)

MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models
by: Cao, Jie, et al.
Published: (2025)

APT-Pipe: A Prompt-Tuning Tool for Social Data Annotation using ChatGPT
by: Zhu, Yiming, et al.
Published: (2024)

MRJ-Agent: An Effective Jailbreak Agent for Multi-Round Dialogue
by: Wang, Fengxiang, et al.
Published: (2024)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
by: Sun, Mengyang, et al.
Published: (2025)

SFDFusion: An Efficient Spatial-Frequency Domain Fusion Network for Infrared and Visible Image Fusion
by: Hu, Kun, et al.
Published: (2024)

Visual Adversarial Attacks and Defenses in the Physical World: A Survey
by: Wei, Xingxing, et al.
Published: (2022)

NAP-Tuning: Neural Augmented Prompt Tuning for Adversarially Robust Vision-Language Models
by: Zhang, Jiaming, et al.
Published: (2025)