Position: Embracing Negative Results in Machine Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Karl, Florian, Kemeter, Lukas Malte, Dax, Gabriel, Sierak, Paulina
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909218394603520
author Karl, Florian
Kemeter, Lukas Malte
Dax, Gabriel
Sierak, Paulina
author_facet Karl, Florian
Kemeter, Lukas Malte
Dax, Gabriel
Sierak, Paulina
contents Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.
format Preprint
id arxiv_https___arxiv_org_abs_2406_03980
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Position: Embracing Negative Results in Machine Learning
Karl, Florian
Kemeter, Lukas Malte
Dax, Gabriel
Sierak, Paulina
Machine Learning
Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.
title Position: Embracing Negative Results in Machine Learning
topic Machine Learning
url https://arxiv.org/abs/2406.03980