Mediapartners-Google
Avg Crawl Delay (when set) 23s
Mentions
20,775,008
1.48% of hostnames
Disallow All
88,357
0% of mentions
Allow
487,075
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
22,571
0% of mentions
Disallow Some
12,415,634
59% of mentions
Disallow Some
+ Allow Some
+ Allow Some
224,308
1% of mentions
No Directives
7,536,938
36% of mentions
Average Crawl Delay
23
(when set)