*

Mentions
170,688,441
14.8% of hostnames
Disallow All
25,606,600
15% of mentions
Allow
23,107,875
13% of mentions
Disallow All
+ Allow Some
514,675
0% of mentions
Disallow Some
38,068,680
22% of mentions
Disallow Some
+ Allow Some
53,992,675
31% of mentions
No Directives
29,385,255
17% of mentions
Average Crawl Delay
82
(when set)