Perplexity-User
Avg Crawl Delay (when set) 5s
Mentions
137,428
0.01% of hostnames
Disallow All
93,846
68% of mentions
Allow
6,460
4% of mentions
Disallow All
+ Allow Some
+ Allow Some
157
0% of mentions
Disallow Some
1,115
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
35,267
25% of mentions
No Directives
572
0% of mentions
Average Crawl Delay
5
(when set)