Position: Let's Strengthen Verifiability If We Can't Enforce Reproducibility

📅 👥 3 authors arXiv:2609.35854v1

Authors

Abstract

In the field of Machine Learning, many papers contain empirical results supporting claimed statements or illustrating the performance of a proposed method. However, most practitioners know that (1) results are generally hard to reproduce, and increasingly so, (2) code is not often available to do so, and (3) it hinders the development of research. In this position paper, we analyze and quantify these issues, and make concrete proposals to improve result checkability, if not reproducibility. Code and supporting materials are available at https://github.com/giddyyupp/position-enforce-verifiability.

Paper Information

arXiv ID:
2609.35854v1
Published:

Related Categories