CrawlPactCrawlPact's public, reproducible research and measurement layer for understanding how AI crawler-policy signals and crawler-registry information change over time. This is a different concept from the product's Evidence Observatory UI — see themethodology page for the distinction.
CrawlPact measures public policy signals websites and crawler operators publish. It does not observe or guarantee how external crawlers actually behave.
Registry Observatory
24 tracked crawler records across 9 operators, from registry release 2026.09.1.
View full Registry Observatory reportWebsite Policy Observatory
Not yet published. A website-level policy benchmark requires a separately governed, versioned research corpus with its own privacy and methodology review — see the methodology page for the current corpus decision. Publishing a Registry Observatory first, rather than a weak or unrepresentative website-policy statistic, is a deliberate choice.
Latest research
20 Sept 2026
AI Crawler Registry Landscape — September 2026