AI & LLM Bots Directory

AI training crawlers collecting content for LLM datasets. Blocking has zero SEO impact.

97 tokens
94 profiles
72 safe
20 caution
2 aggressive

Common providers

Pick a provider to see only its crawlers. Each provider also has a full profile under Bot Operators.

All 97 AI & LLM Bots

97 user-agent tokens on 94 profiles. 3 unversioned tokens are covered on the profile of their versioned twin, so searching either spelling finds the same card.

FAQ

How many AI & LLM Bots are tracked?
We currently track 97 user-agent tokens in AI & LLM Bots, documented on 94 profile pages with user-agent strings, safety ratings and blocking rules. 3 unversioned tokens share a profile with their versioned twin.
Which AI & LLM Bots should I never block?
Never block bots with 'critical' impact rating - there are 0 in this category. Blocking them removes your site from their search results.
Are all AI & LLM Bots safe?
Out of the 94 profiles in this category: 72 safe, 20 caution, 2 aggressive.
How do I block all AI & LLM Bots at once?
Generate a combined robots.txt block rule for all AI & LLM Bots using our bulk robots.txt generator, or manually list each User-agent + Disallow: / directive.