Instance-wise Supervision-level Optimization in Active Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Matsuo, Shinnosuke, Togashi, Riku, Bise, Ryoma, Uchida, Seiichi, Nomura, Masahiro
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910865364615168
author Matsuo, Shinnosuke
Togashi, Riku
Bise, Ryoma
Uchida, Seiichi
Nomura, Masahiro
author_facet Matsuo, Shinnosuke
Togashi, Riku
Bise, Ryoma
Uchida, Seiichi
Nomura, Masahiro
contents Active learning (AL) is a label-efficient machine learning paradigm that focuses on selectively annotating high-value instances to maximize learning efficiency. Its effectiveness can be further enhanced by incorporating weak supervision, which uses rough yet cost-effective annotations instead of exact (i.e., full) but expensive annotations. We introduce a novel AL framework, Instance-wise Supervision-Level Optimization (ISO), which not only selects the instances to annotate but also determines their optimal annotation level within a fixed annotation budget. Its optimization criterion leverages the value-to-cost ratio (VCR) of each instance while ensuring diversity among the selected instances. In classification experiments, ISO consistently outperforms traditional AL methods and surpasses a state-of-the-art AL approach that combines full and weak supervision, achieving higher accuracy at a lower overall cost. This code is available at https://github.com/matsuo-shinnosuke/ISOAL.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06517
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Instance-wise Supervision-level Optimization in Active Learning
Matsuo, Shinnosuke
Togashi, Riku
Bise, Ryoma
Uchida, Seiichi
Nomura, Masahiro
Computer Vision and Pattern Recognition
Machine Learning
Active learning (AL) is a label-efficient machine learning paradigm that focuses on selectively annotating high-value instances to maximize learning efficiency. Its effectiveness can be further enhanced by incorporating weak supervision, which uses rough yet cost-effective annotations instead of exact (i.e., full) but expensive annotations. We introduce a novel AL framework, Instance-wise Supervision-Level Optimization (ISO), which not only selects the instances to annotate but also determines their optimal annotation level within a fixed annotation budget. Its optimization criterion leverages the value-to-cost ratio (VCR) of each instance while ensuring diversity among the selected instances. In classification experiments, ISO consistently outperforms traditional AL methods and surpasses a state-of-the-art AL approach that combines full and weak supervision, achieving higher accuracy at a lower overall cost. This code is available at https://github.com/matsuo-shinnosuke/ISOAL.
title Instance-wise Supervision-level Optimization in Active Learning
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2503.06517