Unprejudiced Training Auxiliary Tasks Makes Primary Better: A Multi-Task Learning Perspective
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912170412867584 |
|---|---|
| author | Li, Yuanze Feng, Chun-Mei Wang, Qilong Yang, Guanglei Zuo, Wangmeng |
| author_facet | Li, Yuanze Feng, Chun-Mei Wang, Qilong Yang, Guanglei Zuo, Wangmeng |
| contents | Human beings can leverage knowledge from relative tasks to improve learning on a primary task. Similarly, multi-task learning methods suggest using auxiliary tasks to enhance a neural network's performance on a specific primary task. However, previous methods often select auxiliary tasks carefully but treat them as secondary during training. The weights assigned to auxiliary losses are typically smaller than the primary loss weight, leading to insufficient training on auxiliary tasks and ultimately failing to support the main task effectively. To address this issue, we propose an uncertainty-based impartial learning method that ensures balanced training across all tasks. Additionally, we consider both gradients and uncertainty information during backpropagation to further improve performance on the primary task. Extensive experiments show that our method achieves performance comparable to or better than state-of-the-art approaches. Moreover, our weighting strategy is effective and robust in enhancing the performance of the primary task regardless the noise auxiliary tasks' pseudo labels. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_19547 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Unprejudiced Training Auxiliary Tasks Makes Primary Better: A Multi-Task Learning Perspective Li, Yuanze Feng, Chun-Mei Wang, Qilong Yang, Guanglei Zuo, Wangmeng Computer Vision and Pattern Recognition Human beings can leverage knowledge from relative tasks to improve learning on a primary task. Similarly, multi-task learning methods suggest using auxiliary tasks to enhance a neural network's performance on a specific primary task. However, previous methods often select auxiliary tasks carefully but treat them as secondary during training. The weights assigned to auxiliary losses are typically smaller than the primary loss weight, leading to insufficient training on auxiliary tasks and ultimately failing to support the main task effectively. To address this issue, we propose an uncertainty-based impartial learning method that ensures balanced training across all tasks. Additionally, we consider both gradients and uncertainty information during backpropagation to further improve performance on the primary task. Extensive experiments show that our method achieves performance comparable to or better than state-of-the-art approaches. Moreover, our weighting strategy is effective and robust in enhancing the performance of the primary task regardless the noise auxiliary tasks' pseudo labels. |
| title | Unprejudiced Training Auxiliary Tasks Makes Primary Better: A Multi-Task Learning Perspective |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.19547 |