Baiduspider
Avg Crawl Delay (when set) 43s
Mentions
14,426,117
1.21% of hostnames
Disallow All
8,657,900
60% of mentions
Allow
351,212
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
25,232
0% of mentions
Disallow Some
4,809,109
33% of mentions
Disallow Some
+ Allow Some
+ Allow Some
156,556
1% of mentions
No Directives
426,054
2% of mentions
Average Crawl Delay
43
(when set)