llms.txt vs Dark Visitors
llms.txt is listed under llms.txt & schema, Dark Visitors under llms.txt & schema. Shared focus: ai-crawlers. Each name links to the product's own site.
| Category | llms.txt & schema | llms.txt & schema |
|---|---|---|
| Pricing | Open source | Freemium |
| Public code | Yes | No |
| Tags | llms-txt, standard, markdown, ai-crawlers | robots-txt, ai-crawlers, analytics, bots |
| Website | llmstxt.org | darkvisitors.com |
What llms.txt does
Proposal by Jeremy Howard of Answer.AI for a markdown file at /llms.txt that gives language models a short guide to a site and links to its key pages, in a format both people and tools can read.
What Dark Visitors does
Tracks known AI crawlers and agents, generates robots.txt rules to allow or block them and shows analytics on agent traffic. It keeps a public directory listing each crawler and its owner.
Other options
See all llms.txt & schema, or alternatives to llms.txt and Dark Visitors.