DuckDuckBot
Avg Crawl Delay (when set) 25s
Mentions
515,876
0.04% of hostnames
Disallow All
50,368
9% of mentions
Allow
83,666
16% of mentions
Disallow All
+ Allow Some
+ Allow Some
20,642
4% of mentions
Disallow Some
56,856
11% of mentions
Disallow Some
+ Allow Some
+ Allow Some
277,408
53% of mentions
No Directives
26,884
5% of mentions
Average Crawl Delay
25
(when set)