AdsBot-Google
Avg Crawl Delay (when set) 11s
Mentions
15,274,468
1.33% of hostnames
Disallow All
64,369
0% of mentions
Allow
382,846
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
22,652
0% of mentions
Disallow Some
11,326,044
74% of mentions
Disallow Some
+ Allow Some
+ Allow Some
3,317,987
21% of mentions
No Directives
160,522
1% of mentions
Average Crawl Delay
11
(when set)