The Autobench LLM router is live

#1
by PeterKruger - opened
AutoBench org

Hi members of the Autobench community page: @Klevi23 @costgallo @Mattefa @Chivin11 @elenamuia @alessioserra @Neervana @cristianbelli01 @marcotrombetti .

Monday we showed that current LLM routers don't route. Today the Beta Router is live, and it sits in the prize those 17 settings left empty.

More details here: https://huggingface.co/blog/PeterKruger/autobench-beta-router

Same eval engine as the benchmark, different questions, three models only.

Try it on: https://botscanner.ai
API: https://api.autobench.org/v1

Let me know if you need any extra credits.

Method questions welcome. Suggestions to improve even more.

Sign up or log in to comment