CrawlPact

Free tools

llms.txt validator

Enter a domain to check /llms.txt and /llms-full.txt: whether each exists, its size, whether it starts with a top-level Markdown heading, and the links it lists.

Runs the same real audit as the full report and opens it at this check — free, with no account or installation.

What this checks

  • Retrieves /llms.txt and /llms-full.txt through the safe-fetch scanner.
  • Reports the HTTP outcome, file size and whether a top-level (# ) Markdown heading is present.
  • Lists the linked resources the file points to (up to 50).
  • Treats a missing file as informational, never as a fault.

Worked example

llms.txt
# Example Docs

> Reference documentation for the Example API.

## Guides
- [Getting started](https://example.com/docs/start)
- [Authentication](https://example.com/docs/auth)

What the report shows

Example results
Top-level headingPresent
Linked resources2
llms-full.txtNot foundinformational

How to read the result

Not found
The file is optional. Its absence is not an error.
Missing heading
The llmstxt.org proposal starts the file with an H1 naming the site.

What this does not tell you

  • llms.txt is a community proposal, not an IETF or W3C standard. No AI system is known to require it.
  • Google says no special files are needed to appear in AI Overviews or AI Mode.
  • Listed links are reported, not fetched — CrawlPact does not check that each one resolves.

See limitations andmethodology.

Questions

Will an llms.txt file improve my visibility in AI search?
There is no evidence it does for Google, which says no special files are needed for its AI features. Some tools and assistants may read it; CrawlPact does not claim any ranking effect.
Does llms.txt control what AI crawlers may do?
No. It describes your site; it grants or restricts nothing. Crawling preferences live in robots.txt, and use preferences in Content Signals or RSL.

Want the complete picture — and to know when it changes?

This check is one section of the full audit, which also covers every other policy signal and a Policy Health Score. Save the domain from the report to monitor it.

Analytics preferences

CrawlPact uses optional Google Analytics and Microsoft Clarity on public pages to learn which content is useful. Clarity records clicks and scrolling (session replay), with anything you type masked. Neither runs in the app or admin areas, and CrawlPact works the same whether you accept or decline. See the privacy policy.