A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Heim, Eric, Wright, Oren, Shriver, David
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929738175479808
author Heim, Eric
Wright, Oren
Shriver, David
author_facet Heim, Eric
Wright, Oren
Shriver, David
contents One of the main barriers to adoption of Machine Learning (ML) is that ML models can fail unexpectedly. In this work, we aim to provide practitioners a guide to better understand why ML models fail and equip them with techniques they can use to reason about failure. Specifically, we discuss failure as either being caused by lack of reliability or lack of robustness. Differentiating the causes of failure in this way allows us to formally define why models fail from first principles and tie these definitions to engineering concepts and real-world deployment settings. Throughout the document we provide 1) a summary of important theoretic concepts in reliability and robustness, 2) a sampling current techniques that practitioners can utilize to reason about ML model reliability and robustness, and 3) examples that show how these concepts and techniques can apply to real-world settings.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00563
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice
Heim, Eric
Wright, Oren
Shriver, David
Machine Learning
Artificial Intelligence
One of the main barriers to adoption of Machine Learning (ML) is that ML models can fail unexpectedly. In this work, we aim to provide practitioners a guide to better understand why ML models fail and equip them with techniques they can use to reason about failure. Specifically, we discuss failure as either being caused by lack of reliability or lack of robustness. Differentiating the causes of failure in this way allows us to formally define why models fail from first principles and tie these definitions to engineering concepts and real-world deployment settings. Throughout the document we provide 1) a summary of important theoretic concepts in reliability and robustness, 2) a sampling current techniques that practitioners can utilize to reason about ML model reliability and robustness, and 3) examples that show how these concepts and techniques can apply to real-world settings.
title A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2503.00563