Perplexity Is Using Stealth, Undeclared Crawlers To Evade Website No-Crawl Directives
Cloudflare, Monday, August 4th, 2025
We are observing stealth crawling behavior from Perplexity, an AI-powered answer engine.
Although Perplexity initially crawls from their declared user agent, when they are presented with a network block, they appear to obscure their crawling identity in an attempt to circumvent the website's preferences.