Perplexity-User
Avg Crawl Delay (when set) 9s
Mentions
489,056
0.03% of hostnames
Disallow All
323,805
66% of mentions
Allow
94,183
19% of mentions
Disallow All
+ Allow Some
+ Allow Some
668
0% of mentions
Disallow Some
23,419
4% of mentions
Disallow Some
+ Allow Some
+ Allow Some
44,503
9% of mentions
No Directives
2,460
0% of mentions
Average Crawl Delay
9
(when set)