Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.09296 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909223899627520 |
|---|---|
| author | Narayanan, Athmanarayanan Lakshmi Krishnan, Ranganath Machireddy, Amrutha Subedar, Mahesh |
| author_facet | Narayanan, Athmanarayanan Lakshmi Krishnan, Ranganath Machireddy, Amrutha Subedar, Mahesh |
| contents | Foundational vision transformer models have shown impressive few shot performance on many vision tasks. This research presents a novel investigation into the application of parameter efficient fine-tuning methods within an active learning (AL) framework, to advance the sampling selection process in extremely budget constrained classification tasks. The focus on image datasets, known for their out-of-distribution characteristics, adds a layer of complexity and relevance to our study. Through a detailed evaluation, we illustrate the improved AL performance on these challenging datasets, highlighting the strategic advantage of merging parameter efficient fine tuning methods with foundation models. This contributes to the broader discourse on optimizing AL strategies, presenting a promising avenue for future exploration in leveraging foundation models for efficient and effective data annotation in specialized domains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_09296 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Parameter-Efficient Active Learning for Foundational models Narayanan, Athmanarayanan Lakshmi Krishnan, Ranganath Machireddy, Amrutha Subedar, Mahesh Computer Vision and Pattern Recognition Artificial Intelligence Foundational vision transformer models have shown impressive few shot performance on many vision tasks. This research presents a novel investigation into the application of parameter efficient fine-tuning methods within an active learning (AL) framework, to advance the sampling selection process in extremely budget constrained classification tasks. The focus on image datasets, known for their out-of-distribution characteristics, adds a layer of complexity and relevance to our study. Through a detailed evaluation, we illustrate the improved AL performance on these challenging datasets, highlighting the strategic advantage of merging parameter efficient fine tuning methods with foundation models. This contributes to the broader discourse on optimizing AL strategies, presenting a promising avenue for future exploration in leveraging foundation models for efficient and effective data annotation in specialized domains. |
| title | Parameter-Efficient Active Learning for Foundational models |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2406.09296 |