PAPAYA Federated Analytics Stack: Engineering Privacy, Scalability and Practicality
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915215809970176 |
|---|---|
| author | Srinivas, Harish Cormode, Graham Honarkhah, Mehrdad Lurye, Samuel Hehir, Jonathan He, Lunwen Hong, George Magdy, Ahmed Huba, Dzmitry Wang, Kaikai Guo, Shen Bhattacharya, Shoubhik |
| author_facet | Srinivas, Harish Cormode, Graham Honarkhah, Mehrdad Lurye, Samuel Hehir, Jonathan He, Lunwen Hong, George Magdy, Ahmed Huba, Dzmitry Wang, Kaikai Guo, Shen Bhattacharya, Shoubhik |
| contents | Cross-device Federated Analytics (FA) is a distributed computation paradigm designed to answer analytics queries about and derive insights from data held locally on users' devices. On-device computations combined with other privacy and security measures ensure that only minimal data is transmitted off-device, achieving a high standard of data protection. Despite FA's broad relevance, the applicability of existing FA systems is limited by compromised accuracy; lack of flexibility for data analytics; and an inability to scale effectively. In this paper, we describe our approach to combine privacy, scalability, and practicality to build and deploy a system that overcomes these limitations. Our FA system leverages trusted execution environments (TEEs) and optimizes the use of on-device computing resources to facilitate federated data processing across large fleets of devices, while ensuring robust, defensible, and verifiable privacy safeguards. We focus on federated analytics (statistics and monitoring), in contrast to systems for federated learning (ML workloads), and we flag the key differences. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_02340 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PAPAYA Federated Analytics Stack: Engineering Privacy, Scalability and Practicality Srinivas, Harish Cormode, Graham Honarkhah, Mehrdad Lurye, Samuel Hehir, Jonathan He, Lunwen Hong, George Magdy, Ahmed Huba, Dzmitry Wang, Kaikai Guo, Shen Bhattacharya, Shoubhik Machine Learning Cross-device Federated Analytics (FA) is a distributed computation paradigm designed to answer analytics queries about and derive insights from data held locally on users' devices. On-device computations combined with other privacy and security measures ensure that only minimal data is transmitted off-device, achieving a high standard of data protection. Despite FA's broad relevance, the applicability of existing FA systems is limited by compromised accuracy; lack of flexibility for data analytics; and an inability to scale effectively. In this paper, we describe our approach to combine privacy, scalability, and practicality to build and deploy a system that overcomes these limitations. Our FA system leverages trusted execution environments (TEEs) and optimizes the use of on-device computing resources to facilitate federated data processing across large fleets of devices, while ensuring robust, defensible, and verifiable privacy safeguards. We focus on federated analytics (statistics and monitoring), in contrast to systems for federated learning (ML workloads), and we flag the key differences. |
| title | PAPAYA Federated Analytics Stack: Engineering Privacy, Scalability and Practicality |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2412.02340 |