Image Aesthetics Assessment via Learnable Queries
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916455370457088 |
|---|---|
| author | Xiong, Zhiwei Zhang, Yunfan Shen, Zhiqi Ren, Peiran Yu, Han |
| author_facet | Xiong, Zhiwei Zhang, Yunfan Shen, Zhiqi Ren, Peiran Yu, Han |
| contents | Image aesthetics assessment (IAA) aims to estimate the aesthetics of images. Depending on the content of an image, diverse criteria need to be selected to assess its aesthetics. Existing works utilize pre-trained vision backbones based on content knowledge to learn image aesthetics. However, training those backbones is time-consuming and suffers from attention dispersion. Inspired by learnable queries in vision-language alignment, we propose the Image Aesthetics Assessment via Learnable Queries (IAA-LQ) approach. It adapts learnable queries to extract aesthetic features from pre-trained image features obtained from a frozen image encoder. Extensive experiments on real-world data demonstrate the advantages of IAA-LQ, beating the best state-of-the-art method by 2.2% and 2.1% in terms of SRCC and PLCC, respectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_02861 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Image Aesthetics Assessment via Learnable Queries Xiong, Zhiwei Zhang, Yunfan Shen, Zhiqi Ren, Peiran Yu, Han Computer Vision and Pattern Recognition Image aesthetics assessment (IAA) aims to estimate the aesthetics of images. Depending on the content of an image, diverse criteria need to be selected to assess its aesthetics. Existing works utilize pre-trained vision backbones based on content knowledge to learn image aesthetics. However, training those backbones is time-consuming and suffers from attention dispersion. Inspired by learnable queries in vision-language alignment, we propose the Image Aesthetics Assessment via Learnable Queries (IAA-LQ) approach. It adapts learnable queries to extract aesthetic features from pre-trained image features obtained from a frozen image encoder. Extensive experiments on real-world data demonstrate the advantages of IAA-LQ, beating the best state-of-the-art method by 2.2% and 2.1% in terms of SRCC and PLCC, respectively. |
| title | Image Aesthetics Assessment via Learnable Queries |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2309.02861 |