CrawlPact

Evidence and method

Policy Health Score

On this page (5 sections)

The Policy Health Score ranges from 0 to 100 when sufficient evidence is available. It is not a compliance score, a legal score, a security score, or a protection score — it is a weighted summary of how well a website's declared AI crawler policy matches its selected objective.

Weighting

CategoryWeight
Resource availability and validity15%
Syntax and deterministic evaluation20%
Business-objective alignment30%
Cross-signal consistency15%
Registry freshness and explicitness10%
Monitoring and change risk10%

Labels

ScoreLabel
90–100Strong
75–89Good
50–74Needs attention
25–49Weak
0–24Critical
—Incomplete (insufficient evidence)

Optional declarations are neutral

Since ruleset 2026.10.1 (15 October 2026), publishing an optional declaration — an RSL licence, Content Signals, llms.txt or a sitemap — neither adds to nor subtracts from the score. Only a declaration that is present but broken costs points: a licence that cannot be retrieved or does not conform to RSL 1.0, a malformed or ambiguous Content-Signal line, or a sitemap that is not a sitemap. Informational robots.txt notes, such as a recognised extension field, are not syntax problems. The score never rewards adding a directive you don't need. Scans evaluated under ruleset 2026.07.2 keep the scores they were given.

When there is not enough evidence

When a scan cannot retrieve enough policy resources to evaluate confidently, CrawlPact shows "Incomplete" rather than a misleading number — never a gauge that implies false precision.

Reproducibility and comparisons

The same declared policy, evaluated against the same registry version and ruleset version, always produces the same score — see methodology for why. This means a score can change between two scans of an unchanged website for a reason that has nothing to do with that website: a registry or ruleset update. CrawlPact labels a registry update "registry drift" and distinguishes it from "website drift" (a change in what the site itself declares); every report and finding also names the ruleset version it was evaluated with — comparing scores across a registry update is comparing against a different, newer yardstick, not evidence the site got better or worse.

Analytics preferences

CrawlPact uses optional Google Analytics and Microsoft Clarity on public pages to learn which content is useful. Clarity records clicks and scrolling (session replay), with anything you type masked. Neither runs in the app or admin areas, and CrawlPact works the same whether you accept or decline. See the privacy policy.