Skip to content

Commit 2e6b600

Browse files
celsopedrosousaelithrar
authored
Celso/markdown for agents improvements (cloudflare#28367)
* Markdown for Agents improvements * Adds changelog entry * typo * Apply suggestions from PCX review * Use AI Crawl Control instead * Update src/content/changelog/fundamentals/2026-02-16-markdown-for-agents-improvements.mdx Co-authored-by: Matt Silverlock <msilverlock@cloudflare.com> --------- Co-authored-by: Pedro Sousa <680496+pedrosousa@users.noreply.github.com> Co-authored-by: Matt Silverlock <msilverlock@cloudflare.com>
1 parent 3c21cf3 commit 2e6b600

3 files changed

Lines changed: 24 additions & 16 deletions

File tree

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
---
2+
title: Content encoding support for Markdown for Agents and other improvements
3+
description: Markdown for Agents now supports content encoding and larger responses.
4+
products:
5+
- fundamentals
6+
date: 2026-02-16
7+
---
8+
9+
When AI systems request pages from any website that uses Cloudflare and has [Markdown for Agents](/fundamentals/reference/markdown-for-agents/) enabled, they can express the preference for `text/markdown` in the request: our network will automatically and efficiently convert the HTML to markdown, when possible, on the fly.
10+
11+
This release adds the following improvements:
12+
13+
- The origin response limit was raised from 1 MB to 2 MB (2,097,152 bytes).
14+
- We no longer require the origin to send the `content-length` header.
15+
- We now support content encoded responses from the origin.
16+
17+
If you haven’t enabled automatic Markdown conversion yet, visit the [AI Crawl Control](https://dash.cloudflare.com/?to=/:account/:zone/ai) section of the Cloudflare dashboard and enable **Markdown for Agents**.
18+
19+
Refer to our [developer documentation](/fundamentals/reference/markdown-for-agents/) for more details.

src/content/docs/fundamentals/reference/markdown-for-agents.mdx

Lines changed: 2 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -103,23 +103,12 @@ curl https://blog.cloudflare.com/markdown-for-agents/ \
103103

104104
## Limitations
105105

106-
:::note
107-
108-
Markdown for Agents will not return a converted Markdown response when:
109-
110-
- The origin response does not include a `content-length` header.
111-
- The origin response `content-length` exceeds 1 MB (1,048,576 bytes).
112-
113-
In these cases, the original HTML response is returned instead.
114-
:::
115-
116106
- We only convert from HTML, other types of documents may be included in the future.
117-
- We don't support compressed responses from the origin.
118-
- Markdown for Agents is a zone level setting. If you need different settings for different sub-domains of a zone, you need to decouple them to separate zones.
107+
- The origin response cannot exceed 2 MB (2,097,152 bytes).
119108

120109
## Other Markdown conversion APIs
121110

122111
If you’re building AI systems that require arbitrary document conversion from outside Cloudflare or Markdown for Agents is not available from the content source, we provide other ways to convert documents to Markdown for your applications:
123112

124113
- Workers AI [AI.toMarkdown()](https://developers.cloudflare.com/workers-ai/features/markdown-conversion/) supports multiple document types and summarization.
125-
- Browser Rendering [/markdown](https://developers.cloudflare.com/browser-rendering/rest-api/markdown-endpoint/) REST API supports markdown conversion if you need to render a dynamic page or application in a real browser before converting it.
114+
- Browser Rendering [/markdown](https://developers.cloudflare.com/browser-rendering/rest-api/markdown-endpoint/) REST API supports markdown conversion if you need to render a dynamic page or application in a real browser before converting it.

src/content/partials/fundamentals/markdown-for-agents.mdx

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,8 +10,8 @@ To enable Markdown for Agents for your zone in the dashboard:
1010

1111
1. Log into the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account (you need a Pro or Business plan).
1212
2. Select the zone you want to configure.
13-
3. Look for **Quick Actions**.
14-
4. Toggle the **Markdown for Agents** button to enable.
13+
3. Visit the [AI Crawl Control](https://dash.cloudflare.com/?to=/:account/:zone/ai) section.
14+
4. Enable **Markdown for Agents**.
1515

1616
</TabItem> <TabItem label="API">
1717

@@ -83,4 +83,4 @@ curl --request PUT \
8383

8484
This will enable the feature on custom hostnames that have the `content_converter` custom metadata tag set.
8585

86-
</TabItem> </Tabs>
86+
</TabItem> </Tabs>

0 commit comments

Comments
 (0)