Amazing Things Come From Having Many Good Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913424282222592 |
|---|---|
| author | Rudin, Cynthia Zhong, Chudi Semenova, Lesia Seltzer, Margo Parr, Ronald Liu, Jiachang Katta, Srikar Donnelly, Jon Chen, Harry Boner, Zachery |
| author_facet | Rudin, Cynthia Zhong, Chudi Semenova, Lesia Seltzer, Margo Parr, Ronald Liu, Jiachang Katta, Srikar Donnelly, Jon Chen, Harry Boner, Zachery |
| contents | The Rashomon Effect, coined by Leo Breiman, describes the phenomenon that there exist many equally good predictive models for the same dataset. This phenomenon happens for many real datasets and when it does, it sparks both magic and consternation, but mostly magic. In light of the Rashomon Effect, this perspective piece proposes reshaping the way we think about machine learning, particularly for tabular data problems in the nondeterministic (noisy) setting. We address how the Rashomon Effect impacts (1) the existence of simple-yet-accurate models, (2) flexibility to address user preferences, such as fairness and monotonicity, without losing performance, (3) uncertainty in predictions, fairness, and explanations, (4) reliable variable importance, (5) algorithm choice, specifically, providing advanced knowledge of which algorithms might be suitable for a given problem, and (6) public policy. We also discuss a theory of when the Rashomon Effect occurs and why. Our goal is to illustrate how the Rashomon Effect can have a massive impact on the use of machine learning for complex problems in society. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_04846 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Amazing Things Come From Having Many Good Models Rudin, Cynthia Zhong, Chudi Semenova, Lesia Seltzer, Margo Parr, Ronald Liu, Jiachang Katta, Srikar Donnelly, Jon Chen, Harry Boner, Zachery Machine Learning Artificial Intelligence The Rashomon Effect, coined by Leo Breiman, describes the phenomenon that there exist many equally good predictive models for the same dataset. This phenomenon happens for many real datasets and when it does, it sparks both magic and consternation, but mostly magic. In light of the Rashomon Effect, this perspective piece proposes reshaping the way we think about machine learning, particularly for tabular data problems in the nondeterministic (noisy) setting. We address how the Rashomon Effect impacts (1) the existence of simple-yet-accurate models, (2) flexibility to address user preferences, such as fairness and monotonicity, without losing performance, (3) uncertainty in predictions, fairness, and explanations, (4) reliable variable importance, (5) algorithm choice, specifically, providing advanced knowledge of which algorithms might be suitable for a given problem, and (6) public policy. We also discuss a theory of when the Rashomon Effect occurs and why. Our goal is to illustrate how the Rashomon Effect can have a massive impact on the use of machine learning for complex problems in society. |
| title | Amazing Things Come From Having Many Good Models |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2407.04846 |