Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2411.11543 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915100346023936 |
|---|---|
| author | Liu, Zhendong Nie, Yuanbi Tan, Yingshui Liu, Jiaheng Yue, Xiangyu Cui, Qiushi Wang, Chongjun Zhu, Xiaoyong Zheng, Bo |
| author_facet | Liu, Zhendong Nie, Yuanbi Tan, Yingshui Liu, Jiaheng Yue, Xiangyu Cui, Qiushi Wang, Chongjun Zhu, Xiaoyong Zheng, Bo |
| contents | Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly vulnerable, allowing attackers to bypass safety alignment in LLMs through visually transmitted content, launching harmful attacks. To address this challenge, we propose a progressive concept-based alignment strategy, PSA-VLM, which incorporates safety modules as concept bottlenecks to enhance visual modality safety alignment. By aligning model predictions with specific safety concepts, we improve defenses against risky images, enhancing explainability and controllability while minimally impacting general performance. Our method is obtained through two-stage training. The low computational cost of the first stage brings very effective performance improvement, and the fine-tuning of the language model in the second stage further improves the safety performance. Our method achieves state-of-the-art results on popular VLM safety benchmark. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_11543 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PSA-VLM: Enhancing Vision-Language Model Safety through Progressive Concept-Bottleneck-Driven Alignment Liu, Zhendong Nie, Yuanbi Tan, Yingshui Liu, Jiaheng Yue, Xiangyu Cui, Qiushi Wang, Chongjun Zhu, Xiaoyong Zheng, Bo Computer Vision and Pattern Recognition Artificial Intelligence Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly vulnerable, allowing attackers to bypass safety alignment in LLMs through visually transmitted content, launching harmful attacks. To address this challenge, we propose a progressive concept-based alignment strategy, PSA-VLM, which incorporates safety modules as concept bottlenecks to enhance visual modality safety alignment. By aligning model predictions with specific safety concepts, we improve defenses against risky images, enhancing explainability and controllability while minimally impacting general performance. Our method is obtained through two-stage training. The low computational cost of the first stage brings very effective performance improvement, and the fine-tuning of the language model in the second stage further improves the safety performance. Our method achieves state-of-the-art results on popular VLM safety benchmark. |
| title | PSA-VLM: Enhancing Vision-Language Model Safety through Progressive Concept-Bottleneck-Driven Alignment |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2411.11543 |