Mistral Search Index: User Agent, robots.txt Rules & Safety

Q: How do I block Mistral Search Index in robots.txt?

Add the following lines to your /robots.txt file: User-agent: MistralAI-Index Disallow: / This instructs Mistral Search Index not to crawl any path on your site. To block only specific sections, replace / with the path (e.g., Disallow: /blog/).

Q: How do I verify if Mistral Search Index is crawling my site?

Search your web server access logs for the string MistralAI-Index (case-insensitive: grep -i "MistralAI-Index" /var/log/nginx/access.log). Filter by user-agent in your log analytics tool (GoAccess, AWStats, etc.).

Quick Facts

User-Agent:: MistralAI-Index
Category:: AI & LLM Bots
Operator:: Mistral AI
Safety:: Safe
Blocking Impact:: Low - No SEO ranking impact
SEO Impact Score:: 2/10
Official docs:: mistral.ai

What is Mistral Search Index?

Mistral Search Index is an AI search-index crawler operated by Mistral AI. It collects and indexes web content so it can be surfaced as citations or answers inside Mistral AI's AI search experience. Allowing Mistral Search Index can increase your visibility in AI-powered search results, which is why most sites choose to permit it.

Mistral Search Index is an AI search-index crawler operated by Mistral AI. It collects and indexes web content so it can be surfaced as citations or answers inside Mistral AI's AI search experience. Allowing Mistral Search Index can increase your visibility in AI-powered search results, which is why most sites choose to permit it. Mistral Search Index uses the user-agent token MistralAI-Index. You can control it via robots.txt, meta tags (noai), or the emerging llms.txt standard. Robots.txt is voluntary; for hard enforcement, combine it with server-level IP blocking.

What happens if you block Mistral Search Index?

✅ **No SEO Impact** - Blocking Mistral Search Index does not affect your rankings in Google, Bing, or any other search engine. Mistral Search Index is an AI crawler, not a traditional search indexer. You can freely block it via User-agent / Disallow: / without any SEO penalty.

Generally safe to allow; provides legitimate crawling value.

How to block Mistral Search Index with robots.txt

<code>User-agent: MistralAI-Index</code> - Matching is case-insensitive. Robots.txt is fetched from the root of each subdomain separately.

Block completely (robots.txt)

User-agent: MistralAI-Index
Disallow: /

Allow all (robots.txt)

User-agent: MistralAI-Index
Allow: /

Block private only (robots.txt)

User-agent: MistralAI-Index
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /

Nginx server block

# Nginx: Hard-block Mistral Search Index
if ($http_user_agent ~* "MistralAI-Index") {
    return 403 "Bot blocked";
}

Apache .htaccess

# Apache: Hard-block Mistral Search Index
SetEnvIfNoCase User-Agent "MistralAI-Index" bad_bot
Order Allow,Deny
Allow from all
Deny from env=bad_bot

Meta robots tag

X-Robots-Tag header

X-Robots-Tag: noindex, nofollow

Is Mistral Search Index safe to allow?

Yes, Mistral Search Index is a **safe and legitimate** crawler operated by Mistral AI. It follows the Robots Exclusion Protocol (RFC 9309) and can be controlled with standard robots.txt rules.

Verify by reverse-DNS lookup: legitimate Mistral Search Index requests resolve to Mistral AI's domain.

What does Mistral Search Index do?

Understanding Mistral Search Index's purpose helps you decide whether to allow or block it.

Indexes web pages for AI-powered search answers
Surfaces your content as citations inside AI search results
Builds a knowledge index used to answer user questions
Allowing it can increase visibility in AI search
Respects robots.txt directives

Frequently Asked Questions

What is the official user-agent string for Mistral Search Index?

The official user-agent string for Mistral Search Index is: MistralAI-Index. Use this exact string in robots.txt, Nginx, Apache, or Cloudflare firewall rules to target this bot. Matching in robots.txt is case-insensitive. Verify a request genuinely comes from Mistral Search Index by performing a reverse-DNS lookup on the source IP.

Is Mistral Search Index safe?

Yes, Mistral Search Index is a **safe and legitimate** crawler operated by Mistral AI. It follows the Robots Exclusion Protocol (RFC 9309) and can be controlled with standard robots.txt rules.

Will blocking Mistral Search Index hurt my SEO?

✅ **No SEO Impact** - Blocking Mistral Search Index does not affect your rankings in Google, Bing, or any other search engine. Mistral Search Index is an AI crawler, not a traditional search indexer. You can freely block it via User-agent / Disallow: / without any SEO penalty.

How do I block Mistral Search Index in robots.txt?

Add the following lines to your /robots.txt file:

User-agent: MistralAI-Index
Disallow: /

This instructs Mistral Search Index not to crawl any path on your site. To block only specific sections, replace / with the path (e.g., Disallow: /blog/).

Does Mistral Search Index respect robots.txt?

Mistral Search Index is operated by Mistral AI and is expected to fetch and parse /robots.txt before crawling, following RFC 9309. For hard enforcement, combine robots.txt with server-level IP or user-agent blocking.

How do I verify if Mistral Search Index is crawling my site?

Search your web server access logs for the string MistralAI-Index (case-insensitive: grep -i "MistralAI-Index" /var/log/nginx/access.log). Filter by user-agent in your log analytics tool (GoAccess, AWStats, etc.).