Seznambot
Avg Crawl Delay (when set) 291s
Mentions
5,768,445
0.41% of hostnames
Disallow All
454,466
7% of mentions
Allow
10,998
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
1,181
0% of mentions
Disallow Some
5,251,821
91% of mentions
Disallow Some
+ Allow Some
+ Allow Some
37,303
0% of mentions
No Directives
12,662
0% of mentions
Average Crawl Delay
291
(when set)