2/13/2026 at 12:17:22 AM
> Sully.ai cut healthcare AI inference costs by 90% (a 10x reduction) while improving response times 65% by switching from proprietary models to open-source models running on Baseten's Blackwell-powered platform, according to Nvidia. The company returned over 30 million minutes to physicians by automating medical coding and note-taking tasks that previously required manual data entry.Are the margins that low that it would make sense to give up on quality of output and use open source models?
by simianwords
2/13/2026 at 1:45:47 AM
Interviewed at Sully, absolutely insane company, I’m sure they aren’t making a rational decision hereby mountainriver