Skip to content
This repository was archived by the owner on Oct 28, 2025. It is now read-only.

Switch to the async API and object_store_ffi infra#3

Merged
gbrgr merged 51 commits intomainfrom
vs-async
Sep 26, 2025
Merged

Switch to the async API and object_store_ffi infra#3
gbrgr merged 51 commits intomainfrom
vs-async

Conversation

@vustef
Copy link
Copy Markdown
Collaborator

@vustef vustef commented Sep 7, 2025

Adds an async API to the Julia FFI.

Asynchronous calls are supported by allowing users to pass a condition variable which is notified on events. The PR also refactors the way objects from iceberg-rust are represented in the C-API. In particular, we now provide an IcebergScan object which corresponds to a Scan in iceberg-rust. Properties like batch size and data file concurrency, etc. can be passed to the IcebergScan.

Comment thread run_integration_test.sh
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Copy link
Copy Markdown
Collaborator Author

@vustef vustef left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Gerald, looks good to me, but I can't approve the PR since I'm the official author. Let's also have @andrebsguedes review and approve this.

Comment thread Cargo.toml Outdated
Comment thread include/iceberg_rust_ffi.h
Comment thread tests/integration_test.c
Comment thread tests/integration_test.c Outdated
Comment thread src/lib.rs
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs
@vustef vustef marked this pull request as ready for review September 24, 2025 10:23
@gbrgr gbrgr merged commit e7bb436 into main Sep 26, 2025
1 check passed
@gbrgr gbrgr deleted the vs-async branch September 26, 2025 13:47
gbrgr added a commit to RelationalAI/RustyIceberg.jl that referenced this pull request Oct 14, 2025
)

Adds support for the async interface provided by iceberg_rust_ffi in
RelationalAI/iceberg_rust_ffi#3

---------

Co-authored-by: Gerald Berger <gberger.work@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants