YetiBot
Avg Crawl Delay (when set) 1158s
Mentions
5,108,234
0.39% of hostnames
Disallow All
4,303
0% of mentions
Allow
268
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
1
0% of mentions
Disallow Some
5,102,455
99% of mentions
Disallow Some
+ Allow Some
+ Allow Some
118
0% of mentions
No Directives
1,089
0% of mentions
Average Crawl Delay
1158
(when set)