Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908411993522176 |
|---|---|
| author | Miyai, Atsuyuki Yang, Jingkang Zhang, Jingyang Ming, Yifei Lin, Yueqian Yu, Qing Irie, Go Joty, Shafiq Li, Yixuan Li, Hai Liu, Ziwei Yamasaki, Toshihiko Aizawa, Kiyoharu |
| author_facet | Miyai, Atsuyuki Yang, Jingkang Zhang, Jingyang Ming, Yifei Lin, Yueqian Yu, Qing Irie, Go Joty, Shafiq Li, Yixuan Li, Hai Liu, Ziwei Yamasaki, Toshihiko Aizawa, Kiyoharu |
| contents | Detecting out-of-distribution (OOD) samples is crucial for ensuring the safety of machine learning systems and has shaped the field of OOD detection. Meanwhile, several other problems are closely related to OOD detection, including anomaly detection (AD), novelty detection (ND), open set recognition (OSR), and outlier detection (OD). To unify these problems, a generalized OOD detection framework was proposed, taxonomically categorizing these five problems. However, Vision Language Models (VLMs) such as CLIP have significantly changed the paradigm and blurred the boundaries between these fields, again confusing researchers. In this survey, we first present a generalized OOD detection v2, encapsulating the evolution of these fields in the VLM era. Our framework reveals that, with some field inactivity and integration, the demanding challenges have become OOD detection and AD. Then, we highlight the significant shift in the definition, problem settings, and benchmarks; we thus feature a comprehensive review of the methodology for OOD detection and related tasks to clarify their relationship to OOD detection. Finally, we explore the advancements in the emerging Large Vision Language Model (LVLM) era, such as GPT-4V. We conclude with open challenges and future directions. The resource is available at https://github.com/AtsuMiyai/Awesome-OOD-VLM. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_21794 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey Miyai, Atsuyuki Yang, Jingkang Zhang, Jingyang Ming, Yifei Lin, Yueqian Yu, Qing Irie, Go Joty, Shafiq Li, Yixuan Li, Hai Liu, Ziwei Yamasaki, Toshihiko Aizawa, Kiyoharu Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Detecting out-of-distribution (OOD) samples is crucial for ensuring the safety of machine learning systems and has shaped the field of OOD detection. Meanwhile, several other problems are closely related to OOD detection, including anomaly detection (AD), novelty detection (ND), open set recognition (OSR), and outlier detection (OD). To unify these problems, a generalized OOD detection framework was proposed, taxonomically categorizing these five problems. However, Vision Language Models (VLMs) such as CLIP have significantly changed the paradigm and blurred the boundaries between these fields, again confusing researchers. In this survey, we first present a generalized OOD detection v2, encapsulating the evolution of these fields in the VLM era. Our framework reveals that, with some field inactivity and integration, the demanding challenges have become OOD detection and AD. Then, we highlight the significant shift in the definition, problem settings, and benchmarks; we thus feature a comprehensive review of the methodology for OOD detection and related tasks to clarify their relationship to OOD detection. Finally, we explore the advancements in the emerging Large Vision Language Model (LVLM) era, such as GPT-4V. We conclude with open challenges and future directions. The resource is available at https://github.com/AtsuMiyai/Awesome-OOD-VLM. |
| title | Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2407.21794 |