GPTBot
Avg Crawl Delay (when set) 15s
Mentions
13,915,095
1.0% of hostnames
Disallow All
8,976,155
64% of mentions
Allow
334,694
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
87,356
0% of mentions
Disallow Some
101,500
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
3,929,683
28% of mentions
No Directives
485,360
3% of mentions
Average Crawl Delay
15
(when set)