FacebookBot
Avg Crawl Delay (when set) 33s
Mentions
5,337,322
0.37% of hostnames
Disallow All
1,634,897
30% of mentions
Allow
99,660
1% of mentions
Disallow All
+ Allow Some
+ Allow Some
71,535
1% of mentions
Disallow Some
49,322
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
3,391,618
63% of mentions
No Directives
90,180
1% of mentions
Average Crawl Delay
33
(when set)