New Bot Detection Update: 10 More Bots Now Identified

We are excited to share that we have expanded our predefined bot list to include 10 new AI-powered bots.
As AI-driven crawlers become increasingly common across the internet, we are committed to keeping you informed and in control by accurately detecting them for you.

Our system can now identify the following newly added bots:

• Mistral AI Bot
• Allen Institute
• Cohere Bot
• Facebook Bot
• Apple Bot
• Perplexity Bot
• Claude Bot
• Anthropic Bot
• OpenAI Search Bot
• ChatGPT Bot

These join our existing list of recognized bots, including:

With this update, our system can now individually detect 33 unique bots for you.

• SEOZoom bot
• Linkpad.ru bot
• CognitiveSEO bot
• Blekko bot
• IBM Watson bot
• Linkdex bot
• OpenLinkProfiler bot
• PagesInventory bot
• BacklinkTest crawler
• Lipperhey spider
• Sistrix bot
• SEOkicks bot
• SearchMetrics crawler
• Archive.org crawler
• BLEXbot (LinkAssistant)
• MOZ bot (DotBot, Rogerbot, Ezooms)
• Baidu bot
• Yandex bot
• Majestic bot
• SemRush bot
• Ahrefs bot
• Bing bot
• Google bot

In addition to identifying these bots by name, we also monitor every request. If we detect that a request might be coming from a bot, we will send this information via HTTP request headers.

In PHP, you can access these headers as follows:

$_SERVER['HTTP_PP_BOT']
$_SERVER['HTTP_PP_BOT_TYPE']

These headers are sent even if you’re using your own web server.

We hope you find this update helpful. 

If you have questions or suggestions, our support team is always ready to assist.