AI Bot Blocker
The AI Bot Blocker is a powerful feature designed to protect your application from unauthorized content scraping by AI crawlers and automated bots. These bots can consume your content, impact server performance, and pose a risk to your intellectual property.
By enabling the AI Bot Blocker, your application is secured using smart detection rules that automatically block known AI scraping tools based on their user-agent strings. This helps you:
- Prevent AI bots from accessing and scraping your content.
- Maintain content privacy and protect intellectual property.
- Reduce unwanted server load caused by automated traffic.
Note: This feature is only available on the Tier 3 and Tier 4 plans. To access the AI Bot Blocker, please upgrade your current plan to Tier 3 or Tier 4.
Let’s see how you can enable and manage the AI Bot Blocker for any application/site on your server.
Step 1: First, log in to the ServerAvatar account, and click on the Server Dashboard button.
Step 2: Now, click on the Applications option from the left-hand sidebar of the Server Panel, and click on the Application Dashboard.
Step 3: Now, you will see the AI Bot Blocker option on the left-hand sidebar of the Application Panel. Click on the AI Bot Blocker.
Step 4: Toggle the switch to enable AI Bot Blocker.
Once enabled, traffic from bots such as GPTBot
, ClaudeBot
, Bard
, YouBot
, PerplexityBot
, and many more will be denied access using rewrite rules.
These rules block requests based on their user-agent string. The [F,L] directive returns a 403 Forbidden response and stops further rule processing.
- You can disable the AI Bot Blocker at any time by toggling the switch back to the Off.
- This feature does not block regular users or search engines unless they use AI-specific crawling agents.