Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 31 additions & 0 deletions es/optimize/seo.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -410,6 +410,37 @@ También puedes especificar `noindex` para todas las páginas de tu documentaci
}
```

<div id="disable-indexing-for-the-entire-project">
### Desactivar la indexación de todo el proyecto
</div>

Para ocultar todo tu despliegue de los motores de búsqueda manteniéndolo públicamente accesible, activa **Don't index project** en tu panel, en **Settings > Deployment > Add-ons > Visibility**.

Cuando se activa, Mintlify:

- Renderiza todas las páginas con las metaetiquetas robots `noindex, nofollow`.
- Devuelve un `sitemap.xml` vacío.
- Devuelve `404` para `llms.txt` y `llms-full.txt`.
- Borra tu índice de búsqueda para que las páginas dejen de aparecer en la búsqueda interna, el [Asistente de IA](/es/assistant/index) o el [servidor MCP](/es/ai/model-context-protocol).
- Sirve un `robots.txt` que bloquea todo el sitio:

```txt
User-agent: *
Content-Signal: ai-train=no, search=no, ai-input=no
Disallow: /
```

Usa esta opción cuando quieras mantener un despliegue en línea para revisión interna, pruebas o uso compartido limitado, pero no quieras que aparezca en los resultados públicos de búsqueda ni que se utilice como datos de entrenamiento o de recuperación para herramientas de IA.

<Note>
Cambiar este ajuste desencadena un redespliegue de tu sitio. Los cambios surten efecto una vez completado el redespliegue.
</Note>

Esta opción funciona junto con otros controles de indexación:

- **`noindex` por página** — Los ajustes `noindex: true` en el frontmatter de una página siguen aplicándose cuando la opción a nivel de proyecto está desactivada. La opción a nivel de proyecto anula los ajustes por página cuando está activada, por lo que todas las páginas se tratan como `noindex`.
- **`robots.txt` personalizado** — Si tienes un [`robots.txt` personalizado](#custom-sitemaps-and-robotstxt-files) en la raíz de tu proyecto, Mintlify lo sirve sin modificaciones. La opción a nivel de proyecto no reemplaza un `robots.txt` personalizado, así que actualiza o elimina tu archivo personalizado por separado si necesitas que las reglas para rastreadores coincidan.

<div id="seo-best-practices">
## Mejores prácticas de SEO
</div>
Expand Down
31 changes: 31 additions & 0 deletions fr/optimize/seo.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -411,6 +411,37 @@ Vous pouvez également définir `noindex` pour toutes les pages de votre documen
}
```

<div id="disable-indexing-for-the-entire-project">
### Désactiver l’indexation pour l’ensemble du projet
</div>

Pour masquer l’intégralité de votre déploiement aux moteurs de recherche tout en le maintenant accessible publiquement, activez **Don't index project** dans votre tableau de bord, sous **Settings > Deployment > Add-ons > Visibility**.

Lorsqu’il est activé, Mintlify :

- Rend chaque page avec les balises meta robots `noindex, nofollow`.
- Renvoie un `sitemap.xml` vide.
- Renvoie `404` pour `llms.txt` et `llms-full.txt`.
- Vide votre index de recherche, de sorte que les pages n’apparaissent plus dans la recherche interne, l’[assistant IA](/fr/assistant/index) ni le [serveur MCP](/fr/ai/model-context-protocol).
- Sert un `robots.txt` qui interdit l’accès à tout le site :

```txt
User-agent: *
Content-Signal: ai-train=no, search=no, ai-input=no
Disallow: /
```

Utilisez cette option lorsque vous souhaitez conserver un déploiement en ligne pour une relecture interne, une mise en préproduction ou un partage limité, sans qu’il apparaisse dans les résultats de recherche publics ni qu’il soit utilisé comme données d’entraînement ou de récupération pour les outils d’IA.

<Note>
Modifier ce paramètre déclenche un redéploiement de votre site. Les changements prennent effet une fois le redéploiement terminé.
</Note>

Ce paramètre fonctionne en complément d’autres contrôles d’indexation :

- **`noindex` par page** — Le `noindex: true` au niveau d’une page dans le frontmatter continue de s’appliquer lorsque le paramètre au niveau du projet est désactivé. Le paramètre au niveau du projet remplace les réglages par page lorsqu’il est activé, et toutes les pages sont alors traitées comme `noindex`.
- **`robots.txt` personnalisé** — Si vous avez un [`robots.txt` personnalisé](#custom-sitemaps-and-robotstxt-files) à la racine de votre projet, Mintlify le sert tel quel. Le paramètre au niveau du projet ne remplace pas un `robots.txt` personnalisé : mettez-le à jour ou supprimez-le séparément si vous souhaitez que les règles pour les robots d’exploration soient cohérentes.

<div id="seo-best-practices">
## Bonnes pratiques SEO
</div>
Expand Down
25 changes: 25 additions & 0 deletions optimize/seo.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -339,9 +339,9 @@
For documentation sites that require authentication, sitemaps and `robots.txt` files also require authenticating to access. Sitemaps exclude pages that belong to [user groups](/deploy/authentication-setup#control-access-with-groups).
</Note>

### Content-Signal directives

Check warning on line 342 in optimize/seo.mdx

View check run for this annotation

Mintlify / Mintlify Validation (mintlify) - vale-spellcheck

optimize/seo.mdx#L342

'Content-Signal directives' should use sentence-style capitalization.

The auto-generated `robots.txt` includes [Content-Signal](https://contentsignals.org) directives that tell AI crawlers how they can use your documentation. These signals follow the Cloudflare Content Signals Policy and apply to all user agents:

Check warning on line 344 in optimize/seo.mdx

View check run for this annotation

Mintlify / Mintlify Validation (mintlify) - vale-spellcheck

optimize/seo.mdx#L344

Use 'AGENTS' instead of 'agents'.

```txt
User-agent: *
Expand All @@ -354,14 +354,14 @@
- `search=yes` — Building search indexes.
- `ai-input=yes` — Generating AI answers, including in retrieval-augmented generation and AI assistants.

These defaults help AI tools like ChatGPT, Claude, and Perplexity discover and cite your documentation. To change the signals, [add a custom `robots.txt`](#custom-sitemaps-and-robotstxt-files) at the root of your project. Custom files are served as-is and do not include the default Content-Signal directives.

Check warning on line 357 in optimize/seo.mdx

View check run for this annotation

Mintlify / Mintlify Validation (mintlify) - vale-spellcheck

optimize/seo.mdx#L357

In general, use active voice instead of passive voice ('are served').

### Custom sitemaps and robots.txt files

To add a custom `sitemap.xml` or `robots.txt` file, create a `sitemap.xml` or `robots.txt` file at the root of your project. Adding a custom file overrides the automatically generated file of the same name. If you delete a custom file, the default file automatically applies again.

<Tip>
If your custom `robots.txt` blocks AI user agents like `GPTBot`, `ClaudeBot`, or `PerplexityBot`, AI tools cannot crawl your documentation and cannot cite it in answers. See [Allow AI agents in robots.txt](/guides/geo#allow-ai-agents-in-robotstxt) for details.

Check warning on line 364 in optimize/seo.mdx

View check run for this annotation

Mintlify / Mintlify Validation (mintlify) - vale-spellcheck

optimize/seo.mdx#L364

Use 'AGENTS' instead of 'agents'.
</Tip>

## Disable indexing
Expand All @@ -388,6 +388,31 @@
}
```

### Disable indexing for the entire project

To hide your entire deployment from search engines while keeping it publicly accessible, enable **Don't index project** on the [Add-ons](https://app.mintlify.com/settings/deployment/addons) page of your dashboard.

When enabled, your site:

- Renders every page with `noindex, nofollow` robots meta tags.
- Returns an empty `sitemap.xml`.
- Returns `404` for `llms.txt` and `llms-full.txt`.
- Clears your search index so pages no longer appear in internal search, the [assistant](/assistant/index), or your [search MCP server](/ai/model-context-protocol).
- Serves a site-wide disallow `robots.txt`:



Disable indexing when you want to keep a deployment online for internal review, staging, or limited sharing, but do not want it to appear in public search results or for AI tools to use it as training or retrieval data.

<Note>
Enabling or disabling indexing redeploys your site. Changes to indexing take effect after the redeployment completes.
</Note>

This setting works alongside other indexing controls:

- **Per-page `noindex`**: Page-level `noindex: true` in frontmatter continues to apply when the project-level setting is off. Project-level settings override per-page settings when enabled.
- **Custom `robots.txt`**: If you have a [custom `robots.txt`](#custom-sitemaps-and-robotstxt-files) at the root of your project, Mintlify serves it unchanged. Project-level settings do not replace custom `robots.txt` files, so you must update or remove custom files for crawler rules to match.

Check warning on line 414 in optimize/seo.mdx

View check run for this annotation

Mintlify / Mintlify Validation (mintlify) - vale-spellcheck

optimize/seo.mdx#L414

'd. P' should have one space.

## SEO best practices

<AccordionGroup>
Expand Down
31 changes: 31 additions & 0 deletions zh/optimize/seo.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -408,6 +408,37 @@ noindex: true
}
```

<div id="disable-indexing-for-the-entire-project">
### 为整个项目禁用索引编入
</div>

要在保持文档公开可访问的同时让搜索引擎不收录整个部署,请在仪表盘的 **Settings > Deployment > Add-ons > Visibility** 下启用 **Don't index project**。

启用后,Mintlify 会:

- 为每个页面渲染 `noindex, nofollow` 的 robots meta 标签。
- 返回空的 `sitemap.xml`。
- 对 `llms.txt` 和 `llms-full.txt` 返回 `404`。
- 清空搜索索引,使页面不再出现在内部搜索、[AI 助手](/zh/assistant/index)或 [MCP 服务器](/zh/ai/model-context-protocol)中。
- 提供一个对整个站点禁止访问的 `robots.txt`:

```txt
User-agent: *
Content-Signal: ai-train=no, search=no, ai-input=no
Disallow: /
```

当你希望保持部署在线以便内部审阅、预演或有限分享,但不希望它出现在公开搜索结果中,或被 AI 工具用作训练或检索数据时,可以使用此选项。

<Note>
切换此设置会触发站点重新部署。更改将在重新部署完成后生效。
</Note>

此设置与其他索引控制配合使用:

- **按页 `noindex`** — 当项目级设置关闭时,frontmatter 中的 `noindex: true` 仍然生效。项目级设置开启时会覆盖按页设置,所有页面都按 `noindex` 处理。
- **自定义 `robots.txt`** — 如果你在项目根目录提供了[自定义 `robots.txt`](#custom-sitemaps-and-robotstxt-files),Mintlify 会原样提供该文件。项目级设置不会替换自定义 `robots.txt`,因此如果需要让爬虫规则保持一致,请单独更新或删除你的自定义文件。

<div id="seo-best-practices">
## SEO 最佳实践
</div>
Expand Down
Loading