feat(physical-ai/cosmos3): add Cosmos3 data flywheel reference architecture#76
Open
ntnadkarni wants to merge 1 commit into
Open
feat(physical-ai/cosmos3): add Cosmos3 data flywheel reference architecture#76ntnadkarni wants to merge 1 commit into
ntnadkarni wants to merge 1 commit into
Conversation
3caafad to
aa7f9d6
Compare
408443f to
7f77d34
Compare
…ecture End-to-end CKS reference for NVIDIA Cosmos3: synthetic robotics-manipulation data generation -> SFT fine-tuning -> DCP->HF export -> Ray Serve -> marimo. Packaged as a small Helm chart (Chart.yaml, values.yaml, 4 templates) so every pipeline step is a single value entry. Default values.yaml renders to a no-op; enable steps individually with `--set steps.<name>.enabled=true` or via an overrides file. Replaces what would otherwise be ~23 nearly- identical Job manifests with one templated definition + per-step bash. Validated single-node on 8x RTX Pro 6000 Blackwell with VAST CSI. Includes the nine upstream workarounds the CKS path required (UPSTREAM_BUGS.md) as candidate PRs back to NVIDIA. A multi-node H100 SXM variant via cw-mpijob is in development on a separate branch. Lives under physical-ai/ so future Cosmos / robotics / world-foundation-model reference architectures can sit alongside. Signed-off-by: Nisha Nadkarni <nnadkarni@coreweave.com>
7f77d34 to
b4a951b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
End-to-end CKS reference architecture for NVIDIA Cosmos3: synthetic data gen → SFT → DCP→HF export → Ray Serve → marimo notebook.
Lives at
physical-ai/cosmos3/, packaged as a Helm chart. Every pipeline step is a singlevalues.yamlentry; enable the ones you want andhelm template . | kubectl apply -f -. Seephysical-ai/cosmos3/README.mdfor the walkthrough andUPSTREAM_BUGS.mdfor the nine upstream patches applied.Apply pattern
🤖 Generated with Claude Code