Skip to content

Refactor file cache handling and improve S3 rename functionality#847

Draft
jfantinhardesty wants to merge 4 commits intomainfrom
cleanup-performance-improvements
Draft

Refactor file cache handling and improve S3 rename functionality#847
jfantinhardesty wants to merge 4 commits intomainfrom
cleanup-performance-improvements

Conversation

@jfantinhardesty
Copy link
Contributor

What type of Pull Request is this? (check all applicable)

  • Refactor
  • Feature
  • Bug Fix
  • Optimization
  • Documentation Update

Describe your changes in brief

Refactored cache space checks into a new checkCacheSpace method in file_cache.go, replacing repetitive code. Removed fallback reopening logic for invalid handles in Truncate. Added a config flag for S3 that defaults to true to skip directory probing for paths ending in file-like extensions, improving performance on miss-heavy paths and refactored function to check for all file-like extensions rather than a few set extensions. Added a check in S3 Storage Rename File to prevent renaming a file to a directory.

Checklist

  • Tested locally
  • Added new dependencies
  • Updated documentation
  • Added tests

Related Issues

  • Related Issue #
  • Closes #

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant