Call for Papers

The Machine Learning Reproducibility Challenge (MLRC 2025) encourages the community to investigate the reproducibility, replicability and generalisability of published claims in top conferences in the literature.

Submissions must be first accepted at TMLR to be considered in the MLRC 2025 Proceedings. Please read the author guidelines and submission guidelines from TMLR to get the submission format and to understand more about the reviewing process. Existing papers related to the scope (with reproducibility certification) already published at TMLR are also welcome for the consideration of the committee. Please read our announcement blog post for more information.

Scope

We invite submissions which conduct novel, unpublished research of reproducibility of machine learning methods and literature, including but not limited to :

  • Methods and tools to foster reproducibility research in Machine Learning
  • Generalisability of published claims: novel insights and results beyond what was presented in the original paper, from any paper (or set of papers) published in top ML conferences and journals.
  • Meta-reproducibility studies on a set of related papers.
  • Meta analysis on the state of reproducibility in various subfields in Machine Learning.

Important Dates

  • Submit to TMLR OpenReview: https://openreview.net/group?id=TMLR
  • Deadline to share your intent to submit a TMLR paper to MLRC: February 21st, 2025 at the following form: https://forms.gle/REgwJQBP8ZXQEaJk7
  • This form requires that you provide a link to your TMLR submission. Once it gets accepted (if it isn’t already), you should then update the same form with your paper camera ready details.
  • Cutoff deadline for receiving TMLR decisions: June 20th, 2025
  • Deadline for announcing accepted papers: June 27th, 2025
  • Conference day: August 21st, 2025 at Princeton University, NJ, USA

Camera Ready Process

  • After you have updated the form with your accepted TMLR paper, it will finally undergo a light AC review to verify MLRC compatibility.
  • AC review will determine the submissions eligible for talks and posters, which will be communicated alongside the acceptance decision.
  • Post acceptance, we will reach out to you for logistics of submitting your videos and posters for the conference.

For query regarding MLRC 2025, contact us at mlrc-2025@googlegroups.com.

Koustuv Sinha

General Chair, MLRC 2025

Last updated on Dec 12, 2024