*

Mentions
179,191,160
15.02% of hostnames
Disallow All
28,409,438
15% of mentions
Allow
19,417,687
10% of mentions
Disallow All
+ Allow Some
535,803
0% of mentions
Disallow Some
40,089,217
22% of mentions
Disallow Some
+ Allow Some
60,599,101
33% of mentions
No Directives
30,126,874
16% of mentions
Average Crawl Delay
84
(when set)