Search Engines Directory

Search engine crawlers that index your content for organic search visibility. Critical to allow.

24 total
23 safe
1 caution
0 aggressive

All 24 Search Engines

FAQ

How many Search Engines are tracked?
We currently track 24 Search Engines with user-agent strings, safety ratings, and blocking rules.
Which Search Engines should I never block?
Never block bots with 'critical' impact rating - there are 24 in this category. Blocking them removes your site from their search results.
Are all Search Engines safe?
Out of 24 bots in this category: 23 safe, 1 caution, 0 aggressive.
How do I block all Search Engines at once?
Generate a combined robots.txt block rule for all Search Engines using our bulk robots.txt generator, or manually list each User-agent + Disallow: / directive.