Seznambot
Avg Crawl Delay (when set) 366s
Mentions
5,005,255
0.42% of hostnames
Disallow All
376,437
7% of mentions
Allow
8,752
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
1,225
0% of mentions
Disallow Some
4,575,960
91% of mentions
Disallow Some
+ Allow Some
+ Allow Some
31,972
0% of mentions
No Directives
10,897
0% of mentions
Average Crawl Delay
366
(when set)