Introducing CausalBench: A Flexible Benchmark Framework for Causal Analysis and Machine Learning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910619063549952 |
|---|---|
| author | Kapkiç, Ahmet Mandal, Pratanu Wan, Shu Sheth, Paras Gorantla, Abhinav Choi, Yoonhyuk Liu, Huan Candan, K. Selçuk |
| author_facet | Kapkiç, Ahmet Mandal, Pratanu Wan, Shu Sheth, Paras Gorantla, Abhinav Choi, Yoonhyuk Liu, Huan Candan, K. Selçuk |
| contents | While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover causal relationships is to use randomized controlled experiments (RCT); in many situations, however, these are impractical or sometimes unethical. Causal learning from observational data offers a promising alternative. While being relatively recent, causal learning aims to go far beyond conventional machine learning, yet several major challenges remain. Unfortunately, advances are hampered due to the lack of unified benchmark datasets, algorithms, metrics, and evaluation service interfaces for causal learning. In this paper, we introduce {\em CausalBench}, a transparent, fair, and easy-to-use evaluation platform, aiming to (a) enable the advancement of research in causal learning by facilitating scientific collaboration in novel algorithms, datasets, and metrics and (b) promote scientific objectivity, reproducibility, fairness, and awareness of bias in causal learning research. CausalBench provides services for benchmarking data, algorithms, models, and metrics, impacting the needs of a broad of scientific and engineering disciplines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_08419 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Introducing CausalBench: A Flexible Benchmark Framework for Causal Analysis and Machine Learning Kapkiç, Ahmet Mandal, Pratanu Wan, Shu Sheth, Paras Gorantla, Abhinav Choi, Yoonhyuk Liu, Huan Candan, K. Selçuk Machine Learning While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover causal relationships is to use randomized controlled experiments (RCT); in many situations, however, these are impractical or sometimes unethical. Causal learning from observational data offers a promising alternative. While being relatively recent, causal learning aims to go far beyond conventional machine learning, yet several major challenges remain. Unfortunately, advances are hampered due to the lack of unified benchmark datasets, algorithms, metrics, and evaluation service interfaces for causal learning. In this paper, we introduce {\em CausalBench}, a transparent, fair, and easy-to-use evaluation platform, aiming to (a) enable the advancement of research in causal learning by facilitating scientific collaboration in novel algorithms, datasets, and metrics and (b) promote scientific objectivity, reproducibility, fairness, and awareness of bias in causal learning research. CausalBench provides services for benchmarking data, algorithms, models, and metrics, impacting the needs of a broad of scientific and engineering disciplines. |
| title | Introducing CausalBench: A Flexible Benchmark Framework for Causal Analysis and Machine Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2409.08419 |