Analysis of meaningful changes in AI crawlers, Google and Bing search reporting, discovery, and publisher controls — checked against the vendors' own documentation, with CrawlPact's own production case studies where we have first-hand evidence.
Insights explain what changed and what it means. For evergreen how-to and decision content see the guides; for what a specific crawler token does, the crawler directory.
Bing Webmaster Tools reports when your pages are cited in Copilot and Bing AI answers. What citations, grounding queries, Intents, Topics, Citation Share and Compare measure — and what they don't.
Google's Search Console now reports generative AI impressions from AI Overviews and AI Mode for every site. What the report measures, what it cannot tell you, and how to use it.
Google reports generative AI impressions; Bing reports AI citations. Why the two aren't comparable, what each is good for, and how to track both without inventing a blended AI visibility score.
A sitemap is an inventory; IndexNow is a change notification. Which search engines use each, why neither guarantees indexing, where Google's Indexing API fits, and a publishing workflow that keeps every signal truthful.
A Bing Site Scan found CrawlPact's own sitemap-listed audit page blocked by robots.txt. The root cause, why the fix was noindex rather than a narrower block, and the regression test that now prevents it.
Found an error? Use the corrections process.
Analytics preferences
CrawlPact uses optional Google Analytics and Microsoft Clarity on public pages to learn which content is useful. Clarity records clicks and scrolling (session replay), with anything you type masked. Neither runs in the app or admin areas, and CrawlPact works the same whether you accept or decline. See the privacy policy.
CrawlPact