AI & ML interests
None defined yet.
Recent Activity
NeurIPS 2026 papers
Pick a result from a NeurIPS 2026 paper. Try to reproduce it with ML Intern. Share your code, logs and verdict so anyone can check your work.
Check a result, report what you find
A claim is a result that a paper reports, for example “our model gets 94.1% accuracy (Table 2)”. In this hackathon you:
- Choose up to 5 NeurIPS 2026 papers.
- Pick one or more claims from each paper.
- Run the experiments yourself, with ML Intern or another AI agent.
- Report whether you got the same result.
Your verdict for each claim is one of: verified (you got the same result), falsified (the claim does not hold), or inconclusive (you could not tell).
Three tracks Draft · names TBD
🔬 Reproduce & verify claims
Reproduce claims from NeurIPS 2026 papers and report your verdict. This is the main track.
🏗️ Build RL environments
Turn a reproduction into an environment that AI agents can practise on, using the Harbor or OpenEnv format. Details TBD
🧩 Build on top of a paper
Build something new from a reproduction: a visualization that explains the paper, or a Gradio workflow app that uses its method.
Four steps
Join and register
Click “Request to join this org” at the top of this page. Then fill in the registration form TBD. Registration closes the day before the hackathon starts.
Choose claims
Use our claim list TBD, or pick claims from any other NeurIPS 2026 paper.
Reproduce
Run the experiments. Keep your code, outputs and logs.
Submit
Put your work in a public Space and send it through the submission form. You can edit and resubmit until the deadline.
Start from a known claim
We are preparing a list of claims from NeurIPS 2026 papers that have released code or model weights. Each claim has an ID (for example neurips26-4821/c2) and points to a figure, table or theorem in the paper.
- Use a claim from the list if you can. Then we can compare your result with other people who chose the same claim.
- Any other NeurIPS 2026 paper is also allowed. Say which figure, table or theorem your claim comes from.
Release date of the list: TBD
One public Space per paper
For each claim, your Space must contain:
| Item | What it means |
|---|---|
| Code | One script that runs the experiment from start to finish. |
| Environment | The exact software versions you used (for example requirements.txt, uv.lock or a Dockerfile). |
| Results | The number the paper reports and the number you got. |
| Logs | The full output of each run, including runs that failed. |
| Verdict | Verified, falsified or inconclusive, with a short reason. |
| Agent trace | The log of your AI agent session, saved to a Hub dataset. ML Intern will have a “Publish Trace” button for this Coming soon |
Then fill in the submission form. It is a Gradio app that checks your Space, shows a checklist of what is complete and what is missing, and marks your submission as complete. AI agents can submit through the same form, because it is also an MCP server. The form also asks which agent and model you used, how much you helped the agent, and whether you looked at other people's reproductions.
Keep it open and honest
- Up to 5 papers per person. You can submit several claims from each paper.
- Any AI agent is allowed. ML Intern is the main focus of the hackathon. Claude Code, Codex, Cursor and others are welcome if you follow the same public upload rules.
- Everything is public: code, environment, results, logs and agent trace.
- Be honest about scale. If you trained for fewer steps or used less data than the paper, say so.
- Falsified claims need proof: a script that shows the problem, and what kind of problem it is (for example an error in the paper or a bug in the official code).
- Remove personal data from your logs and trace before you publish them. You are responsible for what you publish. We plan to provide a tool that helps with this TBD
- Changes after the deadline do not count. We judge your Space as it was at your last submission.
- Teams: TBD · Terms and conditions: TBD
How entries are judged
- Numbers: we re-run your code and compare the result with the number in the paper.
- Figures and plots: scored with a rubric, by AI judges and then by people.
- Leaderboard: a live leaderboard will show submissions as they come in TBD
Full judging criteria: TBD
Planned awards
🔬 Best reproduction
Careful, complete and easy to re-run.
🧨 Best falsification
A claim that does not hold, with a script that proves it and a clear explanation of the problem.
📊 Best visualization
The clearest visual explanation of a paper's key idea.
🧩 Best workflow app
The most useful Gradio workflow app built on a paper.
🗳️ Community choice
The entry the community likes most.
🤝 Sponsor prizes
TBD
Prize amounts: TBD
What you get
💳 $10–$20 Hugging Face credits
For every registered participant. How and when you receive them: TBD
🤖 ML Intern
Hugging Face's AI agent for ML work. It can read papers, write code, run jobs and save results to the Hub. Try ML Intern
📮 Submission form
A Gradio app and MCP server that checks your Space and records your submission. Link: TBD
Key dates
| Date | What happens |
|---|---|
| TBD | Registration opens |
| Nov 19 Tentative | Registration closes |
| Nov 20 Tentative | Hackathon starts |
| Dec 5 Tentative | Submission deadline |
| TBD | Winners announced |
NeurIPS 2026 takes place December 6–13. Plans to share results there: TBD
Everything stays open
We will publish the claim list, all submissions, agent traces and verdicts as open datasets on the Hub. Anyone will be able to see which NeurIPS 2026 results were reproduced.
Questions
Do I have to use ML Intern?
No. You can use any agent, for example Claude Code, Codex or Cursor. Say what you used in the submission form. ML Intern is the main focus of the hackathon.
What if I cannot reproduce the result?
Submit it anyway. A careful “falsified” or “inconclusive” verdict is a useful result.
Why only 5 papers?
We want careful work on a few papers, not quick work on many.
Can I change my submission?
Yes, as many times as you like until the deadline.
Can I register after the hackathon starts?
No. Registration closes the day before the start.
What happens to my submission?
All submissions are public and open-sourced, and may be used to build open datasets and benchmarks.
Questions: Discord channel TBD · @Gradio on X
By taking part you agree to the hackathon terms and conditions TBD, the Hugging Face Code of Conduct and the Content Policy.