FacebookBot
Avg Crawl Delay (when set) 34s
Mentions
5,321,358
0.37% of hostnames
Disallow All
1,623,140
30% of mentions
Allow
92,683
1% of mentions
Disallow All
+ Allow Some
+ Allow Some
70,965
1% of mentions
Disallow Some
47,393
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
3,396,822
63% of mentions
No Directives
90,277
1% of mentions
Average Crawl Delay
34
(when set)