Interplay between Federated Learning and Explainable Artificial Intelligence: a Scoping Review

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lopez-Ramos, Luis M., Leiser, Florian, Rastogi, Aditya, Hicks, Steven, Strümke, Inga, Madai, Vince I., Budig, Tobias, Sunyaev, Ali, Hilbert, Adam
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912318883889152
author Lopez-Ramos, Luis M.
Leiser, Florian
Rastogi, Aditya
Hicks, Steven
Strümke, Inga
Madai, Vince I.
Budig, Tobias
Sunyaev, Ali
Hilbert, Adam
author_facet Lopez-Ramos, Luis M.
Leiser, Florian
Rastogi, Aditya
Hicks, Steven
Strümke, Inga
Madai, Vince I.
Budig, Tobias
Sunyaev, Ali
Hilbert, Adam
contents The joint implementation of federated learning (FL) and explainable artificial intelligence (XAI) could allow training models from distributed data and explaining their inner workings while preserving essential aspects of privacy. Toward establishing the benefits and tensions associated with their interplay, this scoping review maps the publications that jointly deal with FL and XAI, focusing on publications that reported an interplay between FL and model interpretability or post-hoc explanations. Out of the 37 studies meeting our criteria, only one explicitly and quantitatively analyzed the influence of FL on model explanations, revealing a significant research gap. The aggregation of interpretability metrics across FL nodes created generalized global insights at the expense of node-specific patterns being diluted. Several studies proposed FL algorithms incorporating explanation methods to safeguard the learning process against defaulting or malicious nodes. Studies using established FL libraries or following reporting guidelines are a minority. More quantitative research and structured, transparent practices are needed to fully understand their mutual impact and under which conditions it happens.
format Preprint
id arxiv_https___arxiv_org_abs_2411_05874
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Interplay between Federated Learning and Explainable Artificial Intelligence: a Scoping Review
Lopez-Ramos, Luis M.
Leiser, Florian
Rastogi, Aditya
Hicks, Steven
Strümke, Inga
Madai, Vince I.
Budig, Tobias
Sunyaev, Ali
Hilbert, Adam
Machine Learning
Artificial Intelligence
The joint implementation of federated learning (FL) and explainable artificial intelligence (XAI) could allow training models from distributed data and explaining their inner workings while preserving essential aspects of privacy. Toward establishing the benefits and tensions associated with their interplay, this scoping review maps the publications that jointly deal with FL and XAI, focusing on publications that reported an interplay between FL and model interpretability or post-hoc explanations. Out of the 37 studies meeting our criteria, only one explicitly and quantitatively analyzed the influence of FL on model explanations, revealing a significant research gap. The aggregation of interpretability metrics across FL nodes created generalized global insights at the expense of node-specific patterns being diluted. Several studies proposed FL algorithms incorporating explanation methods to safeguard the learning process against defaulting or malicious nodes. Studies using established FL libraries or following reporting guidelines are a minority. More quantitative research and structured, transparent practices are needed to fully understand their mutual impact and under which conditions it happens.
title Interplay between Federated Learning and Explainable Artificial Intelligence: a Scoping Review
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2411.05874