Perplexity-User
Avg Crawl Delay (when set) 9s
Mentions
423,614
0.03% of hostnames
Disallow All
225,722
53% of mentions
Allow
118,067
27% of mentions
Disallow All
+ Allow Some
+ Allow Some
724
0% of mentions
Disallow Some
24,917
5% of mentions
Disallow Some
+ Allow Some
+ Allow Some
51,439
12% of mentions
No Directives
2,724
0% of mentions
Average Crawl Delay
9
(when set)