GPTBot
Avg Crawl Delay (when set) 11s
Mentions
11,382,155
0.87% of hostnames
Disallow All
6,486,591
56% of mentions
Allow
144,693
1% of mentions
Disallow All
+ Allow Some
+ Allow Some
84,949
0% of mentions
Disallow Some
69,128
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
4,107,685
36% of mentions
No Directives
488,911
4% of mentions
Average Crawl Delay
11
(when set)