7/15/2026 at 4:39:56 PM
download link?by Surac
7/15/2026 at 6:25:58 PM
https://huggingface.co/Soofi-Project/Soofi-S-Basehttps://huggingface.co/Soofi-Project/Soofi-S-Instruct-Previe...
by yogthos
7/15/2026 at 4:21:47 PM
by yogthos
7/15/2026 at 4:39:56 PM
download link?by Surac
7/15/2026 at 6:25:58 PM
https://huggingface.co/Soofi-Project/Soofi-S-Basehttps://huggingface.co/Soofi-Project/Soofi-S-Instruct-Previe...
by yogthos
7/15/2026 at 7:30:11 PM
https://x.com/eliebakouch/status/2077428860639973471> gpqa diamond alone makes up 20% of their "capability index" and is responsible for ~70% of the gap between their model and nemotron nano (10 point difference!)
> so what about contamination? i looked at the mixture and they train on a dataset "AIML-TUDA/QA-base" (for 10 epochs lol) that literally is a very very light rephrasing of the gpqa diamond test set
> tl;dr: they trained on 10 epochs of a "very light rephrasing" of EVERY gpqa diamond EVAL data :)
by porridgeraisin