Vercel Firewall can now block AI training crawlers while still letting AI assistants fetch your pages
Since Oct 29, the AI Bots managed ruleset on all plans takes a separate Log or Deny action for AI crawlers (training bots like GPTBot and ClaudeBot) and AI assistants (fetchers like ChatGPT-User and PerplexityBot), set under Security > Firewall > Rules or with vercel firewall rules edit ai-bots --category ai-crawlers --action deny. Check bots.fyi first, since Applebot sits in the crawler bucket too.