6/19/2026 at 7:36:31 AM
I wish people would follow this, instead of coming up with new standards in the root namespace. "llms.txt" [1] comes to mind, for example.Let's stop polluting the root of a domain!
by reddalo
6/19/2026 at 8:05:06 AM
LLMs.txt is also nonsense since it isn't adopted by any of the major AI players.by rickette
6/19/2026 at 9:08:20 AM
Google has recently added `llms.txt` to Chrome's Lighthouse check for agentic browsing (https://searchengineland.com/google-llms-txt-chrome-lighthou...), so adoption may be coming. Admittedly, I put more faith in <link rel="alternate" type="text/markdown" href="https://example.com/foo.md" title="Markdown version of the <Foo> page">
that I copied from Gwern.net. This convention is discoverable (just read the HTML) and naturally adapts to any website size and structure.I have created an `llms.txt` for my website anyhow. I use a fixed LLM prompt to generate it from the internal links in `index.md`.
by networked
6/19/2026 at 9:56:38 AM
Giving a markdown version of a page seems like an interesting choice instead of just embedding a schema marked up oneby iamacyborg
6/19/2026 at 10:18:39 AM
Every page on code.claude.com has a markdown version available by just appending ".md", and Claude Code knows about it. E.g:by vidarh
6/19/2026 at 10:54:07 AM
After some consideration, I also applied this convention to every site I build - including content negotiation: Clients can either send an Accept header with their preference, or append an explicit extension (.md|.markdown for Markdown, .json for JSON API responses, or .html for the human HTML page). Together with the content negotiation part, it feels very much like HTTP was intended to work - especially the fact that API clients, AI agents, and humans all use the same URLs, but get the content in the shape they need.by 9dev
6/19/2026 at 11:27:01 AM
I've done this off and on for various sites over the years too, and probably should be more consistent about it. A number of sites do or used to do some variation of this, and I wish it was more widespread. E.g. Reddit will serve up a json version of a sub-dreddit if you do /r/subreddit.jsonby vidarh
6/19/2026 at 3:38:53 PM
Here's how to do it with more recent versions of Hugo:https://photostructure.com/coding/hugo-markdown-output/
(It includes the grandparent's head link suggestion, but it's not just "change .html to .md" because I'm old skool and as a wee nerd was told that URLs ending in .html or .php or whatever we're frowned on, so the above link's markdown is available by appending /index.md )
by mceachen
6/19/2026 at 2:17:22 PM
It gets even more "interesting" for markdown-based systems like Astro or Obsidian Publish: author in md -> ship html && optionally serve md?by chrisweekly
6/19/2026 at 9:51:33 AM
The same could be said of robots.txtAnd anything else that might tell them not to access something.
by dspillett
6/19/2026 at 12:40:05 PM
robots.txt predates the modern web thoughby reddalo
6/19/2026 at 4:10:38 PM
My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
by dspillett
6/19/2026 at 12:56:27 PM
To be fair, "not adopted by any major AI player" is probably the most web-standard-compliant phase of a new web standard.by pfannl