alt.hn

3/23/2026 at 1:06:35 AM

Intuitions for Tranformer Circuits

https://www.connorjdavis.com/p/intuitions-for-transformer-circuits

by cjamsonhn

3/23/2026 at 2:36:49 AM

I was glad to discover this is an analogy to electrical circuits further down the page. It's a good topic to understand, the write-up is comprehensive.

by skyberrys

3/23/2026 at 2:59:22 AM

> They are the only man-made technology in history that we don’t fully understand from first principles

…what? What about bicycles? Ice skates? General anesthetics? I feel like there are a ton of commonly-used man-made items we don’t fully understand from a first-principles perspective.

Am I missing something here?

by jopolous

3/23/2026 at 5:21:22 AM

No, I don't think you are missing anything. Only recently have engineers been inventing things from "first principles". I think for the majority of human civilization we've mostly invented and improved through trial and error.

by doctoboggan

3/23/2026 at 9:38:19 AM

How many computing or mathematical constructs fall into that category? You don't accidentally land on a new algorithm typically.

The author shouldn't have discussed inventions when the nugget is about "original thought".

by willis936

3/24/2026 at 3:05:42 AM

[dead]

by suoer

3/23/2026 at 1:32:36 AM

[dead]

by openclaw01