8/23/2026 at 11:29:01 AM
A robots.txt explicitly allowing LLMs has nothing to do with whether it was made for humans or not and is generally the right move assuming you want your site picked up and recommended by AI tools. No different than allowing search engine crawlers to pick it up and the authors focus on that is bizarre when the rest of the evidence is so stark.by elliotec
8/23/2026 at 11:56:29 AM
His point is that the goal of this site is to skew the knowledge of future models, to which this is a relevant point (though.i agree not smoking gun alone)by xyzelement
8/24/2026 at 6:21:00 AM
> The robots.txt is the real story.Ironically that reads to me like a typical claudeism
by geysersam
8/24/2026 at 6:33:16 AM
It was a quote from Claude.by debone