Saved in:
Bibliographic Details
Main Authors: Guo, Ziyan, Xu, Li, Liu, Jun
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2311.09680
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909089709162496
author Guo, Ziyan
Xu, Li
Liu, Jun
author_facet Guo, Ziyan
Xu, Li
Liu, Jun
contents The rapid progress of Large Models (LMs) has recently revolutionized various fields of deep learning with remarkable grades, ranging from Natural Language Processing (NLP) to Computer Vision (CV). However, LMs are increasingly challenged and criticized by academia and industry due to their powerful performance but untrustworthy behavior, which urgently needs to be alleviated by reliable methods. Despite the abundance of literature on trustworthy LMs in NLP, a systematic survey specifically delving into the trustworthiness of LMs in CV remains absent. In order to mitigate this gap, we summarize four relevant concerns that obstruct the trustworthy usage in vision of LMs in this survey, including 1) human misuse, 2) vulnerability, 3) inherent issue and 4) interpretability. By highlighting corresponding challenge, countermeasures, and discussion in each topic, we hope this survey will facilitate readers' understanding of this field, promote alignment of LMs with human expectations and enable trustworthy LMs to serve as welfare rather than disaster for human society.
format Preprint
id arxiv_https___arxiv_org_abs_2311_09680
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Trustworthy Large Models in Vision: A Survey
Guo, Ziyan
Xu, Li
Liu, Jun
Computer Vision and Pattern Recognition
Artificial Intelligence
The rapid progress of Large Models (LMs) has recently revolutionized various fields of deep learning with remarkable grades, ranging from Natural Language Processing (NLP) to Computer Vision (CV). However, LMs are increasingly challenged and criticized by academia and industry due to their powerful performance but untrustworthy behavior, which urgently needs to be alleviated by reliable methods. Despite the abundance of literature on trustworthy LMs in NLP, a systematic survey specifically delving into the trustworthiness of LMs in CV remains absent. In order to mitigate this gap, we summarize four relevant concerns that obstruct the trustworthy usage in vision of LMs in this survey, including 1) human misuse, 2) vulnerability, 3) inherent issue and 4) interpretability. By highlighting corresponding challenge, countermeasures, and discussion in each topic, we hope this survey will facilitate readers' understanding of this field, promote alignment of LMs with human expectations and enable trustworthy LMs to serve as welfare rather than disaster for human society.
title Trustworthy Large Models in Vision: A Survey
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2311.09680