Skip to main content

Bot Protection

Learning Focus

By the end of this lesson you will understand Cloudflare's bot management features and how to configure them.

What Bot Protection Does

Cloudflare identifies and blocks malicious bots while allowing legitimate bots (like Googlebot) through. It uses:

  • Known bot signatures
  • Machine learning classification
  • JavaScript challenges
  • CAPTCHA challenges

Configuring in Cloudflare

  1. SecurityBots in the Cloudflare dashboard
  2. Enable Bot Fight Mode (free tier)
  3. Configure Bot Management (paid plans) for more granular control

Good Bots vs Bad Bots

Bot TypeActionExamples
Verified search enginesAllowGooglebot, Bingbot
AI crawlersAllow or block (your choice)GPTBot, ClaudeBot
ScrapersChallenge or blockContent theft bots
DDoS botsBlockAttack botnets

Key Takeaways

  • Cloudflare bot management filters automated traffic at the edge.
  • Bot Fight Mode is available on the free tier and handles most common bots.
  • Allow verified search engine bots for SEO while blocking scrapers.

What's Next