Skip to content

[python] Support BlobView feature#8021

Draft
discivigour wants to merge 10 commits into
apache:masterfrom
discivigour:p/blobView1
Draft

[python] Support BlobView feature#8021
discivigour wants to merge 10 commits into
apache:masterfrom
discivigour:p/blobView1

Conversation

@discivigour
Copy link
Copy Markdown
Contributor

Summary

  • Add Python BlobViewStruct / BlobView wire-format support and the blob-view-field option.
  • Store descriptor/view BLOB fields inline, validate bad inline field configuration and payloads, and avoid writing new .blob files for view fields.
  • Resolve blob-view fields during reads through catalog-aware lookup, returning bytes by default or upstream BlobDescriptor bytes when blob-as-descriptor=true.

Tests

  • DataBlobWriterTest.test_blob_view_fields_resolve_upstream_blob()
  • BlobTest.test_blob_view_struct_roundtrip()

leaves12138 and others added 10 commits May 28, 2026 17:08
# Conflicts:
#	paimon-python/pypaimon/common/options/core_options.py
#	paimon-python/pypaimon/read/reader/blob_descriptor_convert_reader.py
#	paimon-python/pypaimon/read/reader/data_file_batch_reader.py
#	paimon-python/pypaimon/read/split_read.py
#	paimon-python/pypaimon/schema/schema.py
#	paimon-python/pypaimon/table/row/blob.py
#	paimon-python/pypaimon/tests/blob_test.py
#	paimon-python/pypaimon/write/writer/data_blob_writer.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants