BLEXBot
Avg Crawl Delay (when set) 69s
Mentions
8,553,116
0.74% of hostnames
Disallow All
8,367,865
97% of mentions
Allow
1,061
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
2,268
0% of mentions
Disallow Some
33,204
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
2,216
0% of mentions
No Directives
146,487
1% of mentions
Average Crawl Delay
69
(when set)