Bot Operators
91 companies and organizations that operate web crawlers.
All 91 bot operators, ordered by number of bots operated
- Google 27 bots https://developers.google.com/
- Unattributed 11 bots
- OpenAI 8 bots https://openai.com/
- Amazon 7 bots https://www.amazon.com/
- Anthropic 6 bots https://anthropic.com
- Yahoo 5 bots https://www.yahoo.com/
- Meta 5 bots https://www.facebook.com/
- Yandex 4 bots https://yandex.com/
- Semrush 3 bots https://www.semrush.com/
- Internet Archive 3 bots
- Allen Institute for AI 2 bots https://allenai.org/
- DuckDuckGo 2 bots https://duckduckgo.com/
- Mistral AI 2 bots https://mistral.ai/
- Huawei 2 bots https://www.huawei.com/
- Perplexity AI 2 bots https://www.perplexity.ai/
- Cohere 2 bots
- QuillBot 2 bots https://quillbot.com/
- Apple 2 bots https://www.apple.com/
- Baidu 2 bots https://www.baidu.com/
- Microsoft 2 bots https://www.bing.com/
- Mojeek 2 bots
- Seznam 2 bots https://www.seznam.cz/
- Awario 2 bots
- Brandwatch 2 bots
- Brave 2 bots https://brave.com/
- Firecrawl 2 bots https://www.firecrawl.dev/
- Seekr 2 bots
- Turnitin 2 bots https://www.turnitin.com/
- Open Source 2 bots
- YaCy Community 2 bots
- xAI 2 bots
- Big Sur AI 1 bot https://www.bigsur.ai/
- DeepSeek 1 bot https://www.deepseek.com/
- DigitalOcean 1 bot https://www.digitalocean.com/
- LINER 1 bot https://getliner.com/
- You 1 bot https://you.com/
- Open Source Community 1 bot
- Ask 1 bot https://www.ask.com/
- Ahrefs 1 bot https://ahrefs.com/
- Audigent 1 bot https://audigent.com/
- DataForSEO 1 bot https://dataforseo.com/
- Moz 1 bot https://moz.com/
- Majestic 1 bot https://majestic.com/
- Meltwater 1 bot https://www.meltwater.com/
- Neticle 1 bot https://neticle.com/
- Screaming Frog 1 bot https://www.screamingfrog.co.uk/
- Searchmetrics 1 bot https://www.searchmetrics.com/
- Sidetrade 1 bot https://www.sidetrade.com/
- LinkedIn 1 bot https://linkedin.com
- Pinterest 1 bot https://www.pinterest.com/
- Quora 1 bot
- Slack 1 bot https://slack.com/
- WebMeUp 1 bot https://webmeup.com/
- Babbar 1 bot
- ByteDance 1 bot https://www.bytedance.com/
- Common Crawl 1 bot https://commoncrawl.org/
- Diffbot 1 bot
- Dealfront 1 bot
- Echobox 1 bot
- FactSet 1 bot
- ICC 1 bot
- ISS 1 bot
- Jenkers 1 bot
- Livelap 1 bot https://site.livelap.com/
- Moodle 1 bot
- NewsNow 1 bot
- Qualified 1 bot
- Seekport 1 bot
- TaraGroup 1 bot
- Timpi 1 bot
- Velen 1 bot
- Webzio 1 bot
- Alibaba Cloud 1 bot https://www.alibabacloud.com/
- Moonshot AI 1 bot https://www.moonshot.ai/
- Manus 1 bot https://manus.im/
- Cognition AI 1 bot https://cognition.ai/
- Exa 1 bot https://exa.ai/
- Tavily 1 bot https://tavily.com/
- Linkup 1 bot https://www.linkup.so/
- Kagi 1 bot https://kagi.com/
- Phind 1 bot https://www.phind.com/
- WRTN 1 bot https://wrtn.ai/
- iAsk 1 bot https://iask.ai/
- AddSearch 1 bot https://www.addsearch.com/
- Klaviyo 1 bot https://www.klaviyo.com/
- Cloudflare 1 bot https://www.cloudflare.com/
- Zhipu AI 1 bot https://www.zhipuai.cn/
- Andi 1 bot https://andisearch.com/
- aiHit 1 bot https://www.aihitdata.com/
- Hive 1 bot
- X (Twitter) 1 bot