6/18/2026 at 10:54:21 PM
by seandotexe
6/19/2026 at 11:59:53 AM
Nice, thanks!edit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie
by mathisdev7
6/19/2026 at 12:30:40 PM
Thank you for catching! The docs were a bit too eager on the package simplifying I worked on (oops!).. "npm i -g crawlie" is now correctwe're shipping fast, will break less things now though I promise ;)
by seandotexe
6/19/2026 at 7:01:33 AM
That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.by SeriousM
6/19/2026 at 8:28:45 AM
Thank you!! Lots more to comeHonestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.
by seandotexe
6/19/2026 at 6:50:28 PM
[flagged]by picantejohnny51
6/19/2026 at 11:25:25 AM
Niceby davekilleen
6/19/2026 at 12:31:09 PM
Appreciate it Dave! Excited for you to try it outby seandotexe