*

Mentions
256,393,205
17.74% of hostnames
Disallow All
42,125,523
16% of mentions
Allow
70,515,663
27% of mentions
Disallow All
+ Allow Some
435,291
0% of mentions
Disallow Some
44,833,719
17% of mentions
Disallow Some
+ Allow Some
64,169,484
25% of mentions
No Directives
34,003,626
13% of mentions
Average Crawl Delay
77
(when set)