8/21/2026 at 2:20:18 PM
There's some psychological mechanism by which my brain immediately recognizes AI generated text and just short-circuits to "there is no information here".And when I force myself to read AI-generated text I realize I'm making my brain do creative work to impart meaning to the words. It is exhausting because my brain is literally trying to do a just-in-time rewrite of the text into something valuable.
Something is deeply wrong with AI generated output, and I say this as someone who is typically very impressed by AI.
by causal
8/21/2026 at 3:00:17 PM
The "something deeply wrong" part about AI, that even most technology enthusiasts evidently do not seem to grasp, is that it is still fundamentally a statistical model — an algorithmic construct — and does not possess any real intelligence or critical thought whatsoever.No matter how much investors and tech companies want you to believe that they are on the verge of super intelligence, nothing I've seen to date can not easily be explained by "correlation engine", including the "novel" math solutions, all of which appear to just be "a composition of solutions humans have developed and documented elsewhere" upon deeper inspection.
by TalkingCodeMonk
8/21/2026 at 3:35:01 PM
Some of it the effect of tells. “It’s not X, it’s Y” is not a bad pattern but it was baked into the instruction following training set just like the other patterns. I catch myself about to use it and use something else because I want to look human. I have, a few times, tried to use AI to write something that I was struggling to find the words and I just didn’t like how it didn’t seem like my voice. If there was just one person doing it would be OK but when it is 100s of blog posts submitted to HN a day it is like wearing a “I’m an NPC” t-shirt.by PaulHoule
8/21/2026 at 3:23:55 PM
I just can't accept that it possesses no intelligence. It is not equivalent to human intelligence, obviously, but how can a system without some semblance of rational thinking solve open math problems? Even composing earlier human work into something novel requires intelligence and understanding on some level.by pyridines
8/21/2026 at 3:53:57 PM
It has no semantic depth. The sentences and the paragraphs are a statistically viable derivation of existing human text, but once you try to grasp the whole thing with its temporal and spatial dimensions, you are left with a blurry mess that rots your brain. It's a polished, inoffensive and shallow interpretation as written by an opinionated reputation-seeking user of Quora, circa 2019. Assertive, bold, without typos, clean-cut and bulleted, but without an interesting semantic core.by bluetomcat
8/21/2026 at 3:57:09 PM
We couldn't agree on what intelligence means before ChatGPT happened. Now, agreement on the term seems even further awayIf performing well on an IQ test or performing at a high level on knowledge work is intelligence to you, these models are intelligent. If intelligence requires sentience for you, then ... well, I don't think we really agree what that is either, never mind how to measure it. But LLMs certainly don't have it right now
But the consistent trend of the last couple decades (arguably since Turing's time) seems to be that any time a computer reaches our definition of intelligence we decide that that was a flawed definition
by wongarsu
8/21/2026 at 3:29:51 PM
It's just filled to the brim with relations between things. It's good at searching a very large meaning space and create correlations. What it does is to cover great distances and find related things in that large space which needs a long time and large corpus of knowledge to find the connection.This is not intelligence. It's just a good correlation engine with a very big albeit lossy database of things.
by bayindirh
8/21/2026 at 4:24:40 PM
Intelligence is compression, compression requires subtraction, and for some reason LLMs are not good at subtracting. To create a coherent model you kinda have to subtract correlations until only the essential parts are still there.What I don't understand is why LLMs haven't been able to do this yet, if it's the harness or some orchestration layer above the LLM that is needed. Because fundamentally if you can identify correlations then it's just another small step to prioritize and remove lower value or irrelevant correlations.
I wonder if what's needed is to introduce subtraction tokens in some sense, and in post-training reward the model on that.
by rnd33
8/21/2026 at 3:45:14 PM
The very fact that it is able to search within a meaning-space demonstrates that it understands semantics, to some extent. Philosophically, that is profound, for something that is just one big matrix multiplication. Drawing connections between things in meaning-space is surely a facet of intelligence.by pyridines
8/21/2026 at 3:58:07 PM
It’s not intelligence if you are the one who gives the correlations to the model in the pre-training. It’s Word2Vec, applied. Model doesn’t learn anything. You embed these correlations and build it from there. It just searches the space.As my AI professor said in the first lecture: “All AI is advanced search”.
by bayindirh
8/21/2026 at 3:47:58 PM
LLMs are pattern prediction systems with a large training data set. It is not surprising that they can predict patterns, particularly for a well structured field like mathematics that is also amenable to automated proof checking to help steer it.by ThrowawayR2
8/21/2026 at 3:29:21 PM
watch this and see if you think it has intelligence by the endby figers
8/21/2026 at 3:40:40 PM
This looks interesting, but would you mind saying a sentence or two about why before I commit to an hour-long video? It looks like it shows how they work internally, which is sort of a non sequitur. Brains also work mechanistically. I'm claiming that any system which is able to do what AIs do must necessarily have some sort of intelligence.by pyridines
8/21/2026 at 4:08:13 PM
fair reply to an hour video, Scott is just so good to hear his talk is better than I can explain it...go to 24 minutes and 07 seconds.
it's statistically determining what the next word should be based on all the text it's been trained on. It's not intelligence and he shows what probability it puts on each word that it chooses, but also shows a lot of the other words it was thinking of using. In a later part he shows how it uses words that are not the highest probability (and you question why did it go this route, it's not more correct), but the user never sees this, they see what they think is the correct answer always...
he also shows how context you feed it has a lot to do with what it returns... to the point he can get it to return the capital of France is Marseille, just by typing Marseille a bunch of times before the question. Human intelligence doesn't get confused like that.
And it's not a "hallucination", it's just probability of the next token prediction based on the information it's been trained on and fed, it's not intelligence.
by figers
8/21/2026 at 4:44:57 PM
Isn't this a case of missing the trees for the forest though? The human brain is not an LLM, and an LLM is not intelligent in the same way as a human brain.However, an LLM is a prediction machine, prediction IS at the very least one (or the most fundamental) element of intelligence. The brain most surely contains at least some kind of simulacrum of a prediction machine. How that prediction machine is used or wrapped is another matter.
If I said to you: "Blue blue blue, the color of my car is red", would you have absolute confidence in your prediction that my car is red? Or would the way I phrased that sentence make you slightly uncertain, and wonder if there's some miscommunication going on here?
by rnd33
8/21/2026 at 4:55:22 PM
LLMs are awesome awesome tech!A lot of people seem to think it's human level intelligence.
by figers
8/21/2026 at 3:48:05 PM
I wonder if you went back before we had any idea how the brain worked and talked to the smartest people about how neurons work (without giving away that it's a human brain) then asked them all "would such a system be intelligent?" how many would say yes.The main problem I have with people stating it's not intelligent or conscious is I don't think we even have a good definition of either word that satisfies everyone. Philosophers have been trying (and failing) to elegantly define these things forever and everyone out here proclaiming they've got the definitive answer and this specific thing they're seeing doesn't fit under it.
by ragequittah
8/21/2026 at 3:34:21 PM
I also like this: https://laurentiugabriel.github.io/token-town/It shows internals of an LLM nicely, simplified manner.
by bayindirh
8/21/2026 at 4:43:35 PM
I mean this in the kindest way possible, but you are wrong that the math solutions are that easily dismissed. And there are many more than are publicized. A specific math problem I wanted solved for 3 years did not get solved by any model until fable and, and I tried it on every model and know the literature surrounding it well.by GPerson
8/21/2026 at 3:11:45 PM
Thank you for helping me keep my sanity.by tempodox
8/21/2026 at 4:16:34 PM
Completely agree. AI is very impressive in many ways but there is something deeply wrong that is hard to put into words. The output is probable but never true, if that makes sense.I think this is also the mechanism behind why AI generated videos and images are so captivating at first. I remember when Midjourney first launched and it was hours and hours of a brain-melting "Wooooooow". But once you get used to it and start to identify the patterns the brain quickly labels most AI-generated content as blank space.
If the image or text wasn't created by a human, then there was no intent behind the content, there is no message or novel information conveyed, and it reads as noise.
by rnd33
8/21/2026 at 5:13:54 PM
Yeah AI generated content hints that there is a whole world behind it, the way that an image pre-AI was a clue that there was a rich 3D space that corresponded to the image.It seems our brains are adapting to that and recognizing "actually the signal behind this message is quite sparse" even when presented with rich imagery.
by causal
8/21/2026 at 3:18:53 PM
Do you have much exposure to pre-AI corporate memos, mission statements, marketing plans, or white papers? Because they were mostly written in that style. Full of buzzwords, cliche similes, platitudes, jargon and stock phrases.by SoftTalker
8/21/2026 at 3:27:09 PM
The thing is, people writing them had a style. Every company has its own style, or feeling for these kinds of texts. Also for the initiated, these buzzword-filled blocks of text provided some between the lines information; sometimes big, sometimes small.AI generated text doesn't have this. Every model has its bias towards a certain style, an overly agreeable tone, some exaggeration to make the user important and smart, but the text has none of the information crumb these pre-AI texts contained.
Even when you use tools like Grammarly and allow it to "Impact-MAXX" your text, the resulting text is a bland wall of letters, carrying none of your voice or style, less elegant than a corporate text and emptier than space.
It's beyond bland. It's tasteless.
by bayindirh
8/21/2026 at 3:28:30 PM
AI tries to make the prose "interesting". I don't want to read interesting prose. I want to read interesting ideas.by never_inline
8/21/2026 at 3:32:02 PM
The prose is not only interesting, also glorious. Gloriously grandiose, monumentally empty at the same time.It's like a hook of a pop song. Interesting to listen, but entirely empty.
by bayindirh
8/21/2026 at 3:06:27 PM
For some research I looked up some very old Reddit threads a couple of days ago.And, Oh my god, you can actually see how this style of writing influenced AI writing today, I constantly had to remind myself: "this was posted before ChatGPT released".
The reddit influence is especially true for "storytelling" writing.
by LelouBil
8/21/2026 at 4:41:13 PM
People should notice that it is constantly inventing plausible jargon, some of which may or may not have been used in some specific context.by GPerson
8/21/2026 at 4:44:47 PM
It gets worse with language mixing, but I can't help from finding it funny at times, unless it bites me.by moritzwarhier
8/21/2026 at 2:47:21 PM
Are you sure you are not doing the same thing with other texts?I started to skim a lot more text due to me having read a lot. Like in news article, i stoped reading the first paragraph because it repeats just what it was already written in the short subtext. Then there is the second paragarph which is used to have some historical view or whatever it is.
by Flamkuchlo
8/21/2026 at 5:21:50 PM
I am very good at skimming over text. Human-written text I can usually glean the gist from very quickly, and get to choose how much I want to glean from it: The closer I look, the more I find.With AI-written text, it's almost the opposite: the closer I look, the less I find. It is so information-sparse.
by causal
8/21/2026 at 3:46:14 PM
I started skimming reports im required to produce quarterly snd annually. I designed them to provide novel information at start and end so I can update them easily.The problem I encounter is both my memory is degrading, but since these reports are largely duplicative, knowing which version im remembering is technically impossible since theres so much overlap. The overlap is tge same problem as context poisoning.
Id been doing this for over a decade when i started working with a new engineer with a few years of experience and younger. I tried to explain how i set these docs up so they can be skimmed and you can update the specific facts needed. They exclaimed they would never skim and rewrite it all. There was zero way to explain how exhausting that will become as they age.
So theres certain a tension about how people and AI will generate documents.
by cyanydeez
8/21/2026 at 3:12:25 PM
> There's some psychological mechanism by which my brain immediately recognizes AI generated text and just short-circuits to "there is no information here".I think you need to self-correct here, because otherwise you'll be ineffective in an information setting, where I expect AI-generated resources will not only be the norm, they will absolutely swamp the environment.
by peder
8/21/2026 at 5:02:20 PM
AI-generated resources swamping the information environment only makes it more important to have the mental mechanisms for quickly filtering out their non-information.by iceflinger
8/21/2026 at 5:10:01 PM
Yeah I don't think the solution to a flood of useless information is to try and digest more of it.by causal
8/21/2026 at 2:30:30 PM
yes, but now I’m also experiencing that for human-written textby jes5199
8/21/2026 at 2:29:07 PM
> Something is deeply wrong with AI generated outputIt works just fine for me.
by chasd00
8/21/2026 at 2:47:41 PM
You are absolutely right.by SquibblesRedux
8/21/2026 at 2:54:35 PM
haha this made me laughby ghere
8/21/2026 at 3:24:01 PM
That's not funny, it's serious!by fragmede
8/21/2026 at 2:35:45 PM
> my brain immediately recognizes AI generated textI bet it does. I bet it also recognizes some human text as AI text, and doesn't detect other AI text.
by xnx
8/21/2026 at 5:11:18 PM
I am not claiming to have a perfect AI classifier. That is an unnecessary claim that distracts from the broader point.by causal
8/21/2026 at 2:57:09 PM
Show me AI text that manages to climb out of the uncanny valley, and I'll show you AI text that's been edited by a human.by nozzlegear
8/21/2026 at 3:25:57 PM
https://github.com/blader/humanizerby fragmede
8/21/2026 at 3:54:04 PM
The problem is the well's been poisoned just by the fact that I know this is AI trying to hide AI, so I'm already poised to look at the examples and declare "aha! this is obviously AI!" Moreover, it's not single sentences or phrases that make AI text stick out (though obviously those are the biggest tells), it's the text taken as a whole. When you read the full output example in that repo, it seems obvious to me that it's AI (though again, it could be the poisoned well). This is the uncanny valley I was talking about; something is just off about it.by nozzlegear
8/21/2026 at 3:18:58 PM
Once you see past the illusion I think there’s no going back. AI writing style is just dogshit. This hype wave is based on the belief that we’re inching closer to AGI but seems to me we just increasingly struggle to define intelligence. LLMs seem smart because they can pump out thousands of LOC quickly, and enthral you with fancy words and bullet points. I don’t fall for the intelligence illusion anymore.by cedws
8/21/2026 at 5:25:50 PM
I'm not sure we need to declare AGI around the corner nor declare it all dogshit. I think that's part of what's so dissatisfying about it; it strikes at such extremes of both awesome and awful.by causal