An Efficient Learning Framework For Federated XGBoost Using Secret Sharing And Distributed Optimization
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2021
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909530463404032 |
|---|---|
| author | Xie, Lunchen Liu, Jiaqi Lu, Songtao Chang, Tsung-hui Shi, Qingjiang |
| author_facet | Xie, Lunchen Liu, Jiaqi Lu, Songtao Chang, Tsung-hui Shi, Qingjiang |
| contents | XGBoost is one of the most widely used machine learning models in the industry due to its superior learning accuracy and efficiency. Targeting at data isolation issues in the big data problems, it is crucial to deploy a secure and efficient federated XGBoost (FedXGB) model. Existing FedXGB models either have data leakage issues or are only applicable to the two-party setting with heavy communication and computation overheads. In this paper, a lossless multi-party federated XGB learning framework is proposed with a security guarantee, which reshapes the XGBoost's split criterion calculation process under a secret sharing setting and solves the leaf weight calculation problem by leveraging distributed optimization. Remarkably, a thorough analysis of model security is provided as well, and multiple numerical results showcase the superiority of the proposed FedXGB compared with the state-of-the-art models on benchmark datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2105_05717 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | An Efficient Learning Framework For Federated XGBoost Using Secret Sharing And Distributed Optimization Xie, Lunchen Liu, Jiaqi Lu, Songtao Chang, Tsung-hui Shi, Qingjiang Machine Learning Artificial Intelligence Cryptography and Security E.3; I.2.11 XGBoost is one of the most widely used machine learning models in the industry due to its superior learning accuracy and efficiency. Targeting at data isolation issues in the big data problems, it is crucial to deploy a secure and efficient federated XGBoost (FedXGB) model. Existing FedXGB models either have data leakage issues or are only applicable to the two-party setting with heavy communication and computation overheads. In this paper, a lossless multi-party federated XGB learning framework is proposed with a security guarantee, which reshapes the XGBoost's split criterion calculation process under a secret sharing setting and solves the leaf weight calculation problem by leveraging distributed optimization. Remarkably, a thorough analysis of model security is provided as well, and multiple numerical results showcase the superiority of the proposed FedXGB compared with the state-of-the-art models on benchmark datasets. |
| title | An Efficient Learning Framework For Federated XGBoost Using Secret Sharing And Distributed Optimization |
| topic | Machine Learning Artificial Intelligence Cryptography and Security E.3; I.2.11 |
| url | https://arxiv.org/abs/2105.05717 |