Control AI crawler access with robots.txt. Block GPTBot, PerplexityBot, ClaudeBot, Gemini. Step-by-step guide for SEOs managing AI visibility.