Applebot
Avg Crawl Delay (when set) 64s
Mentions
1,589,675
0.11% of hostnames
Disallow All
915,419
57% of mentions
Allow
182,176
11% of mentions
Disallow All
+ Allow Some
+ Allow Some
4,525
0% of mentions
Disallow Some
74,282
4% of mentions
Disallow Some
+ Allow Some
+ Allow Some
158,037
9% of mentions
No Directives
254,954
16% of mentions
Average Crawl Delay
64
(when set)