A Comprehensive Study of Shapley Value in Data Analytics

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lin, Hong, Wan, Shixin, Xie, Zhongle, Chen, Ke, Zhang, Meihui, Shou, Lidan, Chen, Gang
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909677955055616
author Lin, Hong
Wan, Shixin
Xie, Zhongle
Chen, Ke
Zhang, Meihui
Shou, Lidan
Chen, Gang
author_facet Lin, Hong
Wan, Shixin
Xie, Zhongle
Chen, Ke
Zhang, Meihui
Shou, Lidan
Chen, Gang
contents Over the recent years, Shapley value (SV), a solution concept from cooperative game theory, has found numerous applications in data analytics (DA). This paper presents the first comprehensive study of SV used throughout the DA workflow, clarifying the key variables in defining DA-applicable SV and the essential functionalities that SV can provide for data scientists. We condense four primary challenges of using SV in DA, namely computation efficiency, approximation error, privacy preservation, and interpretability, disentangle the resolution techniques from existing arts in this field, then analyze and discuss the techniques w.r.t. each challenge and the potential conflicts between challenges.We also implement SVBench, a modular and extensible open-source framework for developing SV applications in different DA tasks, and conduct extensive evaluations to validate our analyses and discussions. Based on the qualitative and quantitative results, we identify the limitations of current efforts for applying SV to DA and highlight the directions of future research and engineering.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01460
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Comprehensive Study of Shapley Value in Data Analytics
Lin, Hong
Wan, Shixin
Xie, Zhongle
Chen, Ke
Zhang, Meihui
Shou, Lidan
Chen, Gang
Databases
Machine Learning
Over the recent years, Shapley value (SV), a solution concept from cooperative game theory, has found numerous applications in data analytics (DA). This paper presents the first comprehensive study of SV used throughout the DA workflow, clarifying the key variables in defining DA-applicable SV and the essential functionalities that SV can provide for data scientists. We condense four primary challenges of using SV in DA, namely computation efficiency, approximation error, privacy preservation, and interpretability, disentangle the resolution techniques from existing arts in this field, then analyze and discuss the techniques w.r.t. each challenge and the potential conflicts between challenges.We also implement SVBench, a modular and extensible open-source framework for developing SV applications in different DA tasks, and conduct extensive evaluations to validate our analyses and discussions. Based on the qualitative and quantitative results, we identify the limitations of current efforts for applying SV to DA and highlight the directions of future research and engineering.
title A Comprehensive Study of Shapley Value in Data Analytics
topic Databases
Machine Learning
url https://arxiv.org/abs/2412.01460