Seznambot
Avg Crawl Delay (when set) 342s
Mentions
5,597,608
0.43% of hostnames
Disallow All
387,770
6% of mentions
Allow
9,531
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
1,934
0% of mentions
Disallow Some
5,154,482
92% of mentions
Disallow Some
+ Allow Some
+ Allow Some
32,425
0% of mentions
No Directives
11,452
0% of mentions
Average Crawl Delay
342
(when set)