DuckDuckBot
Avg Crawl Delay (when set) 19s
Mentions
658,866
0.05% of hostnames
Disallow All
79,580
12% of mentions
Allow
168,778
25% of mentions
Disallow All
+ Allow Some
+ Allow Some
22,083
3% of mentions
Disallow Some
56,077
8% of mentions
Disallow Some
+ Allow Some
+ Allow Some
296,011
44% of mentions
No Directives
36,264
5% of mentions
Average Crawl Delay
19
(when set)