CrawlPact

PerplexityBot

User-agent token
PerplexityBot
Purpose
Search
Status
active
Last verified
2026-09-08

PerplexityBot crawls and indexes web content that Perplexity’s search product may cite when answering user queries. Perplexity’s own documentation states this crawler respects robots.txt rules, and recommends allowing PerplexityBot in your site’s robots.txt file if you want your content to be discoverable in Perplexity’s search results.

Site-owner controls

Disallowing PerplexityBot removes this content from consideration when Perplexity’s search product cites sources in its AI-generated answers — and, unlike Perplexity-User, this rule is actually honoured, since Perplexity’s documentation confirms PerplexityBot respects robots.txt. It does not affect Perplexity-User, the separate user-triggered fetcher Perplexity documents, which generally ignores robots.txt and operates independently of indexing decisions. See /limitations for what a robots.txt rule can and cannot guarantee.

Perplexity also documents Perplexity-User, a separate user-triggered crawler that fetches a specific page in direct response to a user’s request inside a Perplexity product. CrawlPact reports these as distinct rows in the crawler matrix because they serve different purposes.

Example robots.txt configuration

To disallow PerplexityBot specifically, without affecting any other crawler:

User-agent: PerplexityBot
Disallow: /

If no dedicated User-agent: PerplexityBot group exists in a domain's robots.txt, this crawler falls back to whatever the wildcard User-agent: * group says (RFC 9309) — see robots.txt syntax basics for how group selection works.

Official source: https://docs.perplexity.ai/guides/bots

Verified against the source above as of 2026-09-08 — see how CrawlPact verifies crawler information.

See how this applies to your own site

Run a free audit to check your declared AI crawler policy against your own domain, or use the AI crawler checker to check this one crawler specifically.

Audit a domain

Analytics preferences

CrawlPact uses optional Google Analytics and Microsoft Clarity on public marketing pages to understand which content is useful and how visitors actually use it. Neither is used in the authenticated app or admin areas. You can accept or decline analytics without affecting the service.