PerplexityBot
- User-agent token
- PerplexityBot
- Purpose
- Search
- Status
- active
- Last verified
- 2026-09-08
PerplexityBot crawls and indexes web content that Perplexity’s search product may cite when
answering user queries. Perplexity’s own documentation states this crawler respects robots.txt
rules, and recommends allowing PerplexityBot in your site’s robots.txt file if you want your
content to be discoverable in Perplexity’s search results.
Site-owner controls
Disallowing PerplexityBot removes this content from consideration when Perplexity’s search
product cites sources in its AI-generated answers — and, unlike Perplexity-User, this rule is
actually honoured, since Perplexity’s documentation confirms PerplexityBot respects
robots.txt. It does not affect Perplexity-User, the separate user-triggered fetcher Perplexity
documents, which generally ignores robots.txt and operates independently of indexing decisions.
See /limitations for what a robots.txt rule can and cannot guarantee.
Related crawler
Perplexity also documents Perplexity-User, a separate user-triggered crawler that fetches a
specific page in direct response to a user’s request inside a Perplexity product. CrawlPact
reports these as distinct rows in the crawler matrix because they serve different purposes.
Example robots.txt configuration
To disallow PerplexityBot specifically, without affecting any other crawler:
User-agent: PerplexityBot
Disallow: /If no dedicated User-agent: PerplexityBot group exists in a domain's robots.txt, this crawler falls back to whatever the wildcard User-agent: * group says (RFC 9309) — see robots.txt syntax basics for how group selection works.
Verified against the source above as of 2026-09-08 — see how CrawlPact verifies crawler information.
Related crawlers
See how this applies to your own site
Run a free audit to check your declared AI crawler policy against your own domain, or use the AI crawler checker to check this one crawler specifically.
Audit a domain