Skip to content

Add local H5 worker sessions and stale fingerprint guards#952

Draft
anth-volk wants to merge 10 commits into
mainfrom
codex/h5-migration-pr5-worker-session
Draft

Add local H5 worker sessions and stale fingerprint guards#952
anth-volk wants to merge 10 commits into
mainfrom
codex/h5-migration-pr5-worker-session

Conversation

@anth-volk
Copy link
Copy Markdown
Collaborator

Fixes #951

Summary

  • Adds local-area H5 worker session setup for source data, weights, geography, validation context, and bootstrap artifacts.
  • Passes run-scoped config/artifact paths into local-area H5 workers and validates bootstrap inputs before reuse.
  • Rejects stale or missing H5 scope fingerprints and records computed scope fingerprints in step-manifest input identities.

Verification

  • make lint
  • uv run --no-sync pytest tests/unit/test_modal_local_area.py tests/unit/build_outputs/test_bootstrap.py tests/unit/build_outputs/test_validation.py tests/unit/build_outputs/test_worker_session.py tests/unit/test_modal_worker_script.py tests/unit/test_pipeline_source_contracts.py tests/unit/test_step_manifest.py -q
  • uv run --no-sync --with pyyaml python scripts/run_quality_guards.py

@anth-volk anth-volk force-pushed the codex/h5-migration-pr5-worker-session branch from 4851c8d to e4aea33 Compare May 11, 2026 19:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add local H5 worker sessions and stale fingerprint guards

1 participant