Sample report · synthetic data

Sample report — demonstrates report structure using a fictional domain. This is not a live audit of your website.

AI crawler policy report

sample-domain.example

Complete with warnings

Policy Health Score

68/ 100Needs attention

Policy impact summary

Derived from the crawler results and findings below — describes the published policy signals, not actual crawler behaviour. See detailed evidence.

Crawler	Operator	Purpose	Declared result	Matched rule	Line
OAI-SearchBot	OpenAI	Search	Allowed	Allow: /	4
GPTBot	OpenAI	Training	No explicit rule	—	—
ClaudeBot	Anthropic	Training	Blocked	Disallow: /	12
Google-Extended	Google	Training	Blocked	Disallow: /	12
ChatGPT-User OpenAI's own documentation states that, because these actions are initiated by a user, robots.txt rules may not apply to this crawler.	OpenAI	User-triggered	Allowed	Allow: /	4
PerplexityBot	Perplexity	Search	Mixed	Disallow: /private/	8

Medium

sample-training-unspecified

What happened: robots.txt does not name GPTBot in any User-agent group, so no explicit rule currently applies to it.
Why it matters: The selected objective ("Allow search, block training") intends to restrict model-training crawlers, but an unaddressed crawler is not the same as an explicit block.
Evidence: robots.txt, fetched 2026-08-01 — no User-agent group names GPTBot.
Recommended action: Add an explicit Disallow rule naming GPTBot's user-agent token.
Limitation: CrawlPact cannot confirm whether GPTBot actually requests this website — only that no rule currently addresses it.

Ruleset 2026.07.2 · high confidence

Low

sample-conflicting-search-rule

What happened: robots.txt disallows /private/ for PerplexityBot specifically, while allowing the rest of the site.
Why it matters: This may be intentional (protecting a private section) or an unintended narrower rule than other search crawlers receive.
Evidence: robots.txt, fetched 2026-08-01, line 8.
Recommended action: Confirm whether restricting PerplexityBot from /private/ specifically, rather than all crawlers, is intended.

Ruleset 2026.07.2 · medium confidence

No /llms.txt file was found. This is informational — the file is optional.

No /llms-full.txt file was found. This is informational — the file is optional.

No RSL declaration was found at /.well-known/rsl.xml. This is informational — RSL is optional.

RSL is a machine-readable licensing declaration, not technical enforcement — see limitations.

Cloudflare documents Content Signals in robots.txt, not as a response header. CrawlPact still reports a header if one is sent.

No such header was sent.

Content Signals state preferences about how content is used. They do not block crawling, and not every crawler reads them.

What this report does not show. Read these before acting on a result.

This is a sample report generated from a fixture, not a real scan of any website.
Results describe declared public policy signals; they do not prove actual crawler behaviour or compliance.
CrawlPact does not have server-log access and cannot confirm whether any crawler actually requested this site.
Crawler classifications reflect the registry version shown above and may change as operators update their documentation.

Run a free public audit — no installation or server-log access required.