Applebot
Avg Crawl Delay (when set) 69s
Mentions
1,719,759
0.12% of hostnames
Disallow All
958,633
55% of mentions
Allow
242,500
14% of mentions
Disallow All
+ Allow Some
+ Allow Some
4,395
0% of mentions
Disallow Some
118,067
6% of mentions
Disallow Some
+ Allow Some
+ Allow Some
170,893
9% of mentions
No Directives
225,109
13% of mentions
Average Crawl Delay
69
(when set)