Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917615258042368 |
|---|---|
| author | Ahn, Jin-Hyun Kim, Kyungsang Koh, Jeongwan Li, Quanzheng |
| author_facet | Ahn, Jin-Hyun Kim, Kyungsang Koh, Jeongwan Li, Quanzheng |
| contents | Federated learning (FL) has been intensively investigated in terms of communication efficiency, privacy, and fairness. However, efficient annotation, which is a pain point in real-world FL applications, is less studied. In this project, we propose to apply active learning (AL) and sampling strategy into the FL framework to reduce the annotation workload. We expect that the AL and FL can improve the performance of each other complementarily. In our proposed federated active learning (F-AL) method, the clients collaboratively implement the AL to obtain the instances which are considered as informative to FL in a distributed optimization manner. We compare the test accuracies of the global FL models using the conventional random sampling strategy, client-level separate AL (S-AL), and the proposed F-AL. We empirically demonstrate that the F-AL outperforms baseline methods in image classification tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2202_00195 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning Ahn, Jin-Hyun Kim, Kyungsang Koh, Jeongwan Li, Quanzheng Machine Learning Federated learning (FL) has been intensively investigated in terms of communication efficiency, privacy, and fairness. However, efficient annotation, which is a pain point in real-world FL applications, is less studied. In this project, we propose to apply active learning (AL) and sampling strategy into the FL framework to reduce the annotation workload. We expect that the AL and FL can improve the performance of each other complementarily. In our proposed federated active learning (F-AL) method, the clients collaboratively implement the AL to obtain the instances which are considered as informative to FL in a distributed optimization manner. We compare the test accuracies of the global FL models using the conventional random sampling strategy, client-level separate AL (S-AL), and the proposed F-AL. We empirically demonstrate that the F-AL outperforms baseline methods in image classification tasks. |
| title | Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2202.00195 |