alt.hn

7/24/2026 at 8:44:05 PM

AMD and Cerebras Launch AI Inference Solution

 https://www.cerebras.ai/press-release/amd-and-cerebras-announce-industry-leading-ultra-low-latency-and-high-throughput-ai-inference

by rbanffy

7/24/2026 at 10:37:30 PM

I'm not sure I understand. It's Helios but with WSE attached? And it uses one or the other depending on some criteria?

by techgnosis

7/24/2026 at 10:45:29 PM

LLM inference is a two-phase process. The first phase is prompt processing aka prefill. It's compute-heavy but requires relatively low memory bandwidth. The second phase is token generation aka decode, which doesn't require much in the way of FLOPs but wants as much memory bandwidth as possible.

This announcement is for a system to do the first phase on Helios and the second phase on WSE.

by wtallis

7/25/2026 at 5:33:03 AM

It’s disaggregated so you Know it’s good

by JSR_FDED

7/25/2026 at 6:56:28 PM

The two major sides of the system excel at different things that happen to be complementary in AI inference.

by rbanffy

7/24/2026 at 8:50:45 PM

They're a bit late to the party.

by ckrapu

7/25/2026 at 6:55:01 PM

Why would you say that?

by rbanffy

7/25/2026 at 3:51:32 AM

lol when is the music gonna stop?

by sccvcxv

7/25/2026 at 6:58:04 PM

Nobody knows the answer to that, but if it’s efficiency they are aiming for, which results in lower inference costs, it’ll last for a while. The inference to training ratio will only get higher and the margins will only get lower.

by rbanffy

7/26/2026 at 4:54:40 AM

When Etched becomes GA.

by throw1234567891