PetalBot
Avg Crawl Delay (when set) 46s
Mentions
9,046,089
0.63% of hostnames
Disallow All
8,627,846
95% of mentions
Allow
92,306
1% of mentions
Disallow All
+ Allow Some
+ Allow Some
2,426
0% of mentions
Disallow Some
67,237
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
46,579
0% of mentions
No Directives
209,543
2% of mentions
Average Crawl Delay
46
(when set)