alt.hn

6/18/2026 at 2:14:58 PM

Fable 5 pushed Gemma 4 to 255 tok/s on WebGPU

https://xcancel.com/xenovacom/status/2067289897111638484

by kirubakaran

6/18/2026 at 3:20:03 PM

More of a meta comment, but I really wish anthropic would say something about their plans for Fable. We're all just kind of left here floating and aimless, with no idea of what to expect

by freedomben

6/18/2026 at 3:50:43 PM

They're kind of at the mercy of the US government on this, and the government seems to have them in the position you describe.

by rst

6/18/2026 at 4:36:06 PM

Agreed, though it sounds like they could add KYC stuff and restore access for US citizens. I utterly hate that we're at that point and I think it's ludicrous for privacy and just common sense, but it would be nice to know if that's their plan or not for example. Or if their plan is to just wait for the government to decide on something, or if they're planning to sue, or whatever.

by freedomben

6/18/2026 at 6:10:54 PM

> though it sounds like they could add KYC stuff and restore access for US citizens

I suspect so, I just got an email yesterday from Anthropic on their privacy policy update and they added:

> As part of our measures to keep our services safe and secure we may ask you to verify your age or identity, and we've described what we collect and how.

So yeah, ID verification is coming unfortunately. I wonder how that's going to work for team/business/enterprise plans? Is every individual corporate user going to have to submit their ID? How do they handle staying in compliance with the law with credential sharing that can happen within the company from the same IP address?

by thewebguyd

6/18/2026 at 5:25:53 PM

It's so great that the US is against AI regulation and gives corporations freedom to innovate /s

by pornel

6/18/2026 at 7:32:24 PM

yep, and while Anthropic is now spending their time dealing with regulation, the Chinese models have some time to catch up.

I do wonder though, when those models are "mythos class" (whatever that means), will China do the same thing restricting it from export? If they get a model that's better than US companies, I fully expect them to stop open sourcing them for the world (but I hope I'm wrong about that).

by freedomben

6/18/2026 at 11:54:18 PM

China is benefiting a lot from releasing the models open-source and those benefits immediately end if they start doing closed-source releases. It would be very short-sighted

by pitched

6/18/2026 at 5:10:24 PM

some of us knew the cloud was unreliable and chose a better path.

by cyanydeez

6/18/2026 at 6:07:58 PM

Well I would say you just chose ANOTHER sensible path with tradeoffs just like frontier API/subscriptions. Yes you get 100% control, cheaper inference, not having to stare at status.claude.com for like 2 hours per week, complete privacy (assuming local hosting or self hosting on servers).

But, you can’t get Fable level performance. OSS has reliably trailed the frontier by like 4-7 months for years now

by aspenmartin

6/18/2026 at 7:30:13 PM

Exactly, and insert meme "why not both?" I run local models for plenty of things, but for work there's a lot of complexity and Fable handled it so much better than any open model has so far. It's not really a choice for some domains currently.

by freedomben

6/18/2026 at 3:48:12 PM

The US Government has demanded a solution to the Halting Problem squared and by George (Washington) these tinpot facsists are going to get what they demand.

Hard to imagine where things go from here. GLM-5.3 will be released some day, with Fable class capabilities, and the (MAGA) US government will still be faffing around in their alt-reality cinematic bullshitiverse.

by jauntywundrkind

6/18/2026 at 3:52:08 PM

That's very impressive. What's the best way to run these kernels natively on a Mac? I saw that there's a way to plug Claude into Apple's Foundation Models framework, and there's a CLI tool that can access models via that framework. It might be useful to have something so fast and good available via a small CLI tool for various purposes, especially when connected with a small suite of tools I have for things like file editing, showing, simple agentic purposes etc.

by mike_hearn

6/18/2026 at 3:56:28 PM

Either ollama or omlx, both are pretty dang performant. Omlx lets you run Claude code locally though as long as you bootstrap it with the right model

by thomspoon

6/19/2026 at 8:01:24 AM

Omlx is really nice, thanks for the recommendation!

by mike_hearn

6/18/2026 at 5:00:05 PM

Why would you need Omlx? For speed up?

by karussell

6/18/2026 at 5:24:42 PM

Has extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.

by pornel

6/18/2026 at 5:57:31 PM

apologies for a dumb question, is this someone running fable5 on their own machine and it pushed to 255 tok/s? How is that possible (how did a person acquire the model?)

by exabrial

6/18/2026 at 5:59:18 PM

I'm assuming it means that someone used Fable 5 to implement Gemma 4 in WebGPU and it performs at 255 tok/s

by r_lee

6/18/2026 at 7:07:46 PM

It literally says they used it before it was shut down.

by LoganDark

6/18/2026 at 6:48:40 PM

[dead]

by consumer451

6/18/2026 at 5:25:51 PM

> It climbed to 84 tok/s, then hit a wall, insisting further optimization was impossible.

> Hours later, Anthropic rolled back invisible LLM development safeguards, and it hit 255 tok/s.

Wow. Limitnig access to models for other reasons than that you can't physically provide it should be a crime against humanity or the planet or something. So much immediate efficency left on the table for stupid reasons.

by scotty79

6/18/2026 at 5:12:03 PM

I miss Fable. It worked so well -- it was so confident and would actually make decisions on its own that I agreed with. Opus 4.8 feels so dumb now.

by LoganDark