Running Featured 87 QED-Nano: Teaching a Tiny Model to Prove Hard Theorems π 87 Who needs 1T parameters? Olympiad proofs with a 4B model
Running 123 Unlocking On-Policy Distillation for Any Model Family π 123 Explore onβpolicy distillation visualizations for any model
Running 96 Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks π 96 Evaluate multilingual models using FineTasks
Running on CPU Upgrade Featured 3.37k The Smol Training Playbook π 3.37k The secrets to building world-class LLMs
Running 4.13k The Ultra-Scale Playbook π 4.13k The ultimate guide to training LLM on large GPU Clusters