DuckDuckBot
Avg Crawl Delay (when set) 26s
Mentions
476,894
0.04% of hostnames
Disallow All
35,296
7% of mentions
Allow
68,967
14% of mentions
Disallow All
+ Allow Some
+ Allow Some
19,643
4% of mentions
Disallow Some
55,937
11% of mentions
Disallow Some
+ Allow Some
+ Allow Some
271,550
56% of mentions
No Directives
25,452
5% of mentions
Average Crawl Delay
26
(when set)