AdsBot-Google
Avg Crawl Delay (when set) 12s
Mentions
16,224,015
1.16% of hostnames
Disallow All
111,085
0% of mentions
Allow
704,781
4% of mentions
Disallow All
+ Allow Some
+ Allow Some
23,690
0% of mentions
Disallow Some
10,984,508
67% of mentions
Disallow Some
+ Allow Some
+ Allow Some
4,115,286
25% of mentions
No Directives
284,609
1% of mentions
Average Crawl Delay
12
(when set)