Perplexity crawler controls

PerplexityBot indexes search. Perplexity-User fetches on demand.

Perplexity documents PerplexityBot as its search crawler and says it is not used for foundation-model training. Perplexity-User supports user actions and generally ignores robots.txt because the fetch is user initiated.

PerplexityBot

Allow this token if you want pages eligible to surface and receive links in Perplexity search results.

Perplexity-User

A user-request fetcher, not an automatic indexing crawler. A robots.txt result for this agent is advisory.

Request verification

Perplexity publishes separate current IP-range JSON endpoints for both agents and recommends checking the user agent and IP together.

Search example

Source: Perplexity crawler documentation.