Skip to content

[doc] add SeaweedFS integration doc#3607

Merged
morningman merged 2 commits into
apache:masterfrom
chrislusf:add-doris-seaweedfs-doc
May 14, 2026
Merged

[doc] add SeaweedFS integration doc#3607
morningman merged 2 commits into
apache:masterfrom
chrislusf:add-doris-seaweedfs-doc

Conversation

@chrislusf
Copy link
Copy Markdown
Contributor

Versions

  • dev
  • 4.x
  • 3.x
  • 2.1

Languages

  • Chinese
  • English

Summary

Adds an Iceberg lakehouse integration page for SeaweedFS, which exposes both an S3 object endpoint and an Apache Iceberg REST Catalog from the same weed process. The doc walks through:

  1. Starting weed mini with a single IAM config and a pre-created S3 Tables bucket.
  2. Registering the catalog in Doris with iceberg.catalog.type = "rest", where the OAuth2 client credentials and the S3 keys are the same access pair.
  3. Reading and writing an Iceberg table.

The same end-to-end path is exercised in CI by the TestDorisIcebergCatalog integration test in the SeaweedFS repo (test/s3tables/catalog_doris/), which boots SeaweedFS, registers a Doris Iceberg catalog against it, writes rows via PyIceberg, and reads them back from apache/doris:doris-all-in-one-2.1.0. The Doris catalog properties in the doc are the ones the test uses verbatim.

Files

  • 4 English pages: docs/, docs-next/, versioned_docs/version-3.x, versioned_docs/version-4.x
  • 4 Chinese pages: corresponding i18n/zh-CN/... paths
  • 4 sidebars: sidebars.ts, sidebars-next.ts, versioned_sidebars/version-{3,4}.x-sidebars.jsondoris-seaweedfs slotted under the Iceberg Catalog category, after doris-lakekeeper.

I'm the maintainer of SeaweedFS, so I can keep this page in sync with future changes upstream.

@chrislusf chrislusf changed the title [feat] add SeaweedFS integration doc [doc] add SeaweedFS integration doc May 4, 2026
@chrislusf chrislusf marked this pull request as draft May 4, 2026 09:08
@chrislusf chrislusf marked this pull request as ready for review May 4, 2026 09:13
SeaweedFS serves both the S3 object data and the Iceberg REST catalog
from the same `weed` process, with a single S3 credential pair shared
across both. This page shows the minimal Doris setup; the same path
is exercised end-to-end by the TestDorisIcebergCatalog integration
test in the SeaweedFS repo.

[fix](docs) zh: 二进制 -> 执行文件 in SeaweedFS doc

[refactor](docs) reframe SeaweedFS doc benefits around stack-collapsing

2
@morningman morningman force-pushed the add-doris-seaweedfs-doc branch from de1730d to e2ed11a Compare May 14, 2026 22:07
@morningman morningman merged commit 59102c5 into apache:master May 14, 2026
4 checks passed
@chrislusf chrislusf mentioned this pull request May 15, 2026
6 tasks
chrislusf added a commit to chrislusf/doris-website that referenced this pull request May 15, 2026
Trim the page to match the MinIO storage page in scope: drop the SQL
Catalog / Broker Load / TVF examples and the Docker block, replace
with a single properties snippet. Clarify that this page covers S3
normal buckets only; S3 Table Buckets are covered by the existing
Iceberg integration page (apache#3607).
chrislusf added a commit to chrislusf/doris-website that referenced this pull request May 15, 2026
Adds a Storages page for SeaweedFS, mirroring the structure of the
MinIO storage doc. Covers the `s3.*` properties Doris uses to access
a SeaweedFS S3 gateway (Catalog / TVF / Broker Load / Export /
Outfile), with a one-paragraph `weed mini` quick start (single-process
master + volume + filer + S3).

The page is scoped to SeaweedFS S3 (normal) buckets. Iceberg tables
stored in SeaweedFS S3 Table Buckets are covered by the existing
Integration with SeaweedFS page (apache#3607), which the page links to.

Slotted under "Lakehouse > Storages > SeaweedFS", above MinIO, in
sidebars-next.ts and versioned_sidebars/version-{3,4}.x-sidebars.json.
English and Chinese pages for dev, 3.x, and 4.x.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants