arxiv:2607.25180
Yuichi Tateno PRO
hotchpotch
AI & ML interests
Information Retrieval with LLMs
Recent Activity
reacted to tardellirs's post with ๐ 15 minutes ago
Crivo-150M is now on the Pareto frontier of the Decision Index ๐ฏ
Scored by the maintainers on the private tests: Full 22.21, the best of all submissions at or below 150M and higher than every model below 0.75B, including models up to 4ร its size. Median latency on the board's GPU: 13 ms.
It is a 149M typed-decision encoder (Ettin / ModernBERT): a state plus choice, noul or score questions in, a probability for every option out, in one forward pass. Trained on open data only.
Next: tasks from new domains, the weak spot of every small encoder on the board.
https://huggingface.co/tardellirs/crivo-150m
https://huggingface.co/spaces/multimodalart/jev-decision-index
Thanks to @multimodalart for the Decision Index and its open kit, @orionweller and the Ettin team, @tomaarsen for the Ettin rerankers, @hotchpotch for the Bekko System One data and @sileod for tasksource. new activity 22 minutes ago
hotchpotch/s1mb-result:Add five complete native-budget model evaluations updated a Space 23 minutes ago
hotchpotch/S1MB-leaderboard