robots.txt generator for AI bots (GPTBot, ClaudeBot, Perplexity)
Website SEO Audit
A tool that generates a correct robots.txt with rules for AI crawlers — allow or block GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and others. Relevant for controlling who learns from your content. #seo #security #wordpress #ai