Vision encoders should be image size agnostic and task driven
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911116658999296 |
|---|---|
| author | Prisadnikov, Nedyalko Paudel, Danda Pani Fu, Yuqian Van Gool, Luc |
| author_facet | Prisadnikov, Nedyalko Paudel, Danda Pani Fu, Yuqian Van Gool, Luc |
| contents | This position paper argues that the next generation of vision encoders should be image size agnostic and task driven. The source of our inspiration is biological. Not a structural aspect of biological vision, but a behavioral trait -- efficiency. We focus on a couple of ways in which vision in nature is efficient, but modern vision encoders not. We -- humans and animals -- deal with vast quantities of visual data, and need to be smart where we focus our limited energy -- it depends on the task. It is our belief that vision encoders should be dynamic and the computational complexity should depend on the task at hand rather than the size of the image. We, also, provide concrete first steps towards our vision -- a proof-of-concept solution for image classification. Despite classification being not very representative for what we are trying to achieve, it shows that our approach is feasible and promising. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_16317 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Vision encoders should be image size agnostic and task driven Prisadnikov, Nedyalko Paudel, Danda Pani Fu, Yuqian Van Gool, Luc Computer Vision and Pattern Recognition This position paper argues that the next generation of vision encoders should be image size agnostic and task driven. The source of our inspiration is biological. Not a structural aspect of biological vision, but a behavioral trait -- efficiency. We focus on a couple of ways in which vision in nature is efficient, but modern vision encoders not. We -- humans and animals -- deal with vast quantities of visual data, and need to be smart where we focus our limited energy -- it depends on the task. It is our belief that vision encoders should be dynamic and the computational complexity should depend on the task at hand rather than the size of the image. We, also, provide concrete first steps towards our vision -- a proof-of-concept solution for image classification. Despite classification being not very representative for what we are trying to achieve, it shows that our approach is feasible and promising. |
| title | Vision encoders should be image size agnostic and task driven |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.16317 |