Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2305.06061 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911837869572096 |
|---|---|
| author | Yu, Bruce X. B. Chang, Jianlong Wang, Haixin Liu, Lingbo Wang, Shijie Wang, Zhiyu Lin, Junfan Xie, Lingxi Li, Haojie Lin, Zhouchen Tian, Qi Chen, Chang Wen |
| author_facet | Yu, Bruce X. B. Chang, Jianlong Wang, Haixin Liu, Lingbo Wang, Shijie Wang, Zhiyu Lin, Junfan Xie, Lingxi Li, Haojie Lin, Zhouchen Tian, Qi Chen, Chang Wen |
| contents | Fine-tuning visual models has been widely shown promising performance on many downstream visual tasks. With the surprising development of pre-trained visual foundation models, visual tuning jumped out of the standard modus operandi that fine-tunes the whole pre-trained model or just the fully connected layer. Instead, recent advances can achieve superior performance than full-tuning the whole pre-trained parameters by updating far fewer parameters, enabling edge devices and downstream applications to reuse the increasingly large foundation models deployed on the cloud. With the aim of helping researchers get the full picture and future directions of visual tuning, this survey characterizes a large and thoughtful selection of recent works, providing a systematic and comprehensive overview of existing work and models. Specifically, it provides a detailed background of visual tuning and categorizes recent visual tuning techniques into five groups: prompt tuning, adapter tuning, parameter tuning, and remapping tuning. Meanwhile, it offers some exciting research directions for prospective pre-training and various interactions in visual tuning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_06061 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Visual Tuning Yu, Bruce X. B. Chang, Jianlong Wang, Haixin Liu, Lingbo Wang, Shijie Wang, Zhiyu Lin, Junfan Xie, Lingxi Li, Haojie Lin, Zhouchen Tian, Qi Chen, Chang Wen Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning I.2 Fine-tuning visual models has been widely shown promising performance on many downstream visual tasks. With the surprising development of pre-trained visual foundation models, visual tuning jumped out of the standard modus operandi that fine-tunes the whole pre-trained model or just the fully connected layer. Instead, recent advances can achieve superior performance than full-tuning the whole pre-trained parameters by updating far fewer parameters, enabling edge devices and downstream applications to reuse the increasingly large foundation models deployed on the cloud. With the aim of helping researchers get the full picture and future directions of visual tuning, this survey characterizes a large and thoughtful selection of recent works, providing a systematic and comprehensive overview of existing work and models. Specifically, it provides a detailed background of visual tuning and categorizes recent visual tuning techniques into five groups: prompt tuning, adapter tuning, parameter tuning, and remapping tuning. Meanwhile, it offers some exciting research directions for prospective pre-training and various interactions in visual tuning. |
| title | Visual Tuning |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning I.2 |
| url | https://arxiv.org/abs/2305.06061 |