Quantifying Correlations of Machine Learning Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Yuanyuan, Sarna, Neeraj, Lin, Yang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913681435000832
author Li, Yuanyuan
Sarna, Neeraj
Lin, Yang
author_facet Li, Yuanyuan
Sarna, Neeraj
Lin, Yang
contents Machine Learning models are being extensively used in safety critical applications where errors from these models could cause harm to the user. Such risks are amplified when multiple machine learning models, which are deployed concurrently, interact and make errors simultaneously. This paper explores three scenarios where error correlations between multiple models arise, resulting in such aggregated risks. Using real-world data, we simulate these scenarios and quantify the correlations in errors of different models. Our findings indicate that aggregated risks are substantial, particularly when models share similar algorithms, training datasets, or foundational models. Overall, we observe that correlations across models are pervasive and likely to intensify with increased reliance on foundational models and widely used public datasets, highlighting the need for effective mitigation strategies to address these challenges.
format Preprint
id arxiv_https___arxiv_org_abs_2502_03937
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Quantifying Correlations of Machine Learning Models
Li, Yuanyuan
Sarna, Neeraj
Lin, Yang
Machine Learning
Numerical Analysis
Machine Learning models are being extensively used in safety critical applications where errors from these models could cause harm to the user. Such risks are amplified when multiple machine learning models, which are deployed concurrently, interact and make errors simultaneously. This paper explores three scenarios where error correlations between multiple models arise, resulting in such aggregated risks. Using real-world data, we simulate these scenarios and quantify the correlations in errors of different models. Our findings indicate that aggregated risks are substantial, particularly when models share similar algorithms, training datasets, or foundational models. Overall, we observe that correlations across models are pervasive and likely to intensify with increased reliance on foundational models and widely used public datasets, highlighting the need for effective mitigation strategies to address these challenges.
title Quantifying Correlations of Machine Learning Models
topic Machine Learning
Numerical Analysis
url https://arxiv.org/abs/2502.03937