MSTS: A Multimodal Safety Test Suite for Vision-Language Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915107345268736 |
|---|---|
| author | Röttger, Paul Attanasio, Giuseppe Friedrich, Felix Goldzycher, Janis Parrish, Alicia Bhardwaj, Rishabh Di Bonaventura, Chiara Eng, Roman Geagea, Gaia El Khoury Goswami, Sujata Han, Jieun Hovy, Dirk Jeong, Seogyeong Jeretič, Paloma Plaza-del-Arco, Flor Miriam Rooein, Donya Schramowski, Patrick Shaitarova, Anastassia Shen, Xudong Willats, Richard Zugarini, Andrea Vidgen, Bertie |
| author_facet | Röttger, Paul Attanasio, Giuseppe Friedrich, Felix Goldzycher, Janis Parrish, Alicia Bhardwaj, Rishabh Di Bonaventura, Chiara Eng, Roman Geagea, Gaia El Khoury Goswami, Sujata Han, Jieun Hovy, Dirk Jeong, Seogyeong Jeretič, Paloma Plaza-del-Arco, Flor Miriam Rooein, Donya Schramowski, Patrick Shaitarova, Anastassia Shen, Xudong Willats, Richard Zugarini, Andrea Vidgen, Bertie |
| contents | Vision-language models (VLMs), which process image and text inputs, are increasingly integrated into chat assistants and other consumer AI applications. Without proper safeguards, however, VLMs may give harmful advice (e.g. how to self-harm) or encourage unsafe behaviours (e.g. to consume drugs). Despite these clear hazards, little work so far has evaluated VLM safety and the novel risks created by multimodal inputs. To address this gap, we introduce MSTS, a Multimodal Safety Test Suite for VLMs. MSTS comprises 400 test prompts across 40 fine-grained hazard categories. Each test prompt consists of a text and an image that only in combination reveal their full unsafe meaning. With MSTS, we find clear safety issues in several open VLMs. We also find some VLMs to be safe by accident, meaning that they are safe because they fail to understand even simple test prompts. We translate MSTS into ten languages, showing non-English prompts to increase the rate of unsafe model responses. We also show models to be safer when tested with text only rather than multimodal prompts. Finally, we explore the automation of VLM safety assessments, finding even the best safety classifiers to be lacking. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_10057 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MSTS: A Multimodal Safety Test Suite for Vision-Language Models Röttger, Paul Attanasio, Giuseppe Friedrich, Felix Goldzycher, Janis Parrish, Alicia Bhardwaj, Rishabh Di Bonaventura, Chiara Eng, Roman Geagea, Gaia El Khoury Goswami, Sujata Han, Jieun Hovy, Dirk Jeong, Seogyeong Jeretič, Paloma Plaza-del-Arco, Flor Miriam Rooein, Donya Schramowski, Patrick Shaitarova, Anastassia Shen, Xudong Willats, Richard Zugarini, Andrea Vidgen, Bertie Computation and Language Vision-language models (VLMs), which process image and text inputs, are increasingly integrated into chat assistants and other consumer AI applications. Without proper safeguards, however, VLMs may give harmful advice (e.g. how to self-harm) or encourage unsafe behaviours (e.g. to consume drugs). Despite these clear hazards, little work so far has evaluated VLM safety and the novel risks created by multimodal inputs. To address this gap, we introduce MSTS, a Multimodal Safety Test Suite for VLMs. MSTS comprises 400 test prompts across 40 fine-grained hazard categories. Each test prompt consists of a text and an image that only in combination reveal their full unsafe meaning. With MSTS, we find clear safety issues in several open VLMs. We also find some VLMs to be safe by accident, meaning that they are safe because they fail to understand even simple test prompts. We translate MSTS into ten languages, showing non-English prompts to increase the rate of unsafe model responses. We also show models to be safer when tested with text only rather than multimodal prompts. Finally, we explore the automation of VLM safety assessments, finding even the best safety classifiers to be lacking. |
| title | MSTS: A Multimodal Safety Test Suite for Vision-Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2501.10057 |