Applebot
Avg Crawl Delay (when set) 66s
Mentions
1,702,542
0.12% of hostnames
Disallow All
956,425
56% of mentions
Allow
230,025
13% of mentions
Disallow All
+ Allow Some
+ Allow Some
4,390
0% of mentions
Disallow Some
117,596
6% of mentions
Disallow Some
+ Allow Some
+ Allow Some
168,334
9% of mentions
No Directives
225,647
13% of mentions
Average Crawl Delay
66
(when set)