Skip to content

Implement _cp_file for Zonal Buckets & support custom flush interval#746

Merged
ankitaluthra1 merged 15 commits intofsspec:mainfrom
ankitaluthra1:zonal-fix-1
Feb 12, 2026
Merged

Implement _cp_file for Zonal Buckets & support custom flush interval#746
ankitaluthra1 merged 15 commits intofsspec:mainfrom
ankitaluthra1:zonal-fix-1

Conversation

@suni72
Copy link
Copy Markdown
Contributor

@suni72 suni72 commented Jan 19, 2026

Key Changes:

  • Features:
    • Implemented _cp_file logic for Zonal buckets.
    • Added support for custom flush interval for zonal writes.
  • Fixes & Maintenance:
    • Fixed aaow initialization logic in ZonalFile.
    • Updated imports and dependencies to align with the latest python-storage SDK.
    • Improved logging (byte tracking) and updated method descriptions/warnings.
  • CI & Tests:
    • Updated CI configuration to use the latest python-storage.
    • Increased ulimit in tests to prevent "too many open files" errors.
    • Configured separate regional buckets for zonal copy tests.

@suni72 suni72 marked this pull request as draft January 19, 2026 10:31
@suni72 suni72 force-pushed the zonal-fix-1 branch 7 times, most recently from 6b68697 to 2cd21fb Compare January 26, 2026 17:50
@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Jan 26, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 75.87%. Comparing base (6e4efb8) to head (0a55821).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #746      +/-   ##
==========================================
+ Coverage   75.41%   75.87%   +0.46%     
==========================================
  Files          19       19              
  Lines        2859     2881      +22     
==========================================
+ Hits         2156     2186      +30     
+ Misses        703      695       -8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@suni72 suni72 force-pushed the zonal-fix-1 branch 5 times, most recently from 140e1c5 to da12664 Compare January 30, 2026 14:47
@suni72 suni72 changed the title Update ZonalFile commit to log warning instead of raising error for No-op cases Implement _cp_file for Zonal Buckets & support custom flush interval Jan 30, 2026
@suni72 suni72 marked this pull request as ready for review January 30, 2026 15:28
@ankitaluthra1
Copy link
Copy Markdown
Collaborator

/gcbrun

1 similar comment
@ankitaluthra1
Copy link
Copy Markdown
Collaborator

/gcbrun

suni72 and others added 2 commits February 6, 2026 14:13
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
@suni72 suni72 marked this pull request as ready for review February 6, 2026 09:14
Comment thread gcsfs/extended_gcsfs.py Outdated
@ankitaluthra1
Copy link
Copy Markdown
Collaborator

/gcbrun

Comment thread gcsfs/zonal_file.py Outdated
Comment thread gcsfs/extended_gcsfs.py Outdated
@ankitaluthra1
Copy link
Copy Markdown
Collaborator

/gcbrun

1 similar comment
@ankitaluthra1
Copy link
Copy Markdown
Collaborator

/gcbrun

@ankitaluthra1 ankitaluthra1 merged commit f1cc8b4 into fsspec:main Feb 12, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants