Skip to content

Conversation

@dolfinus
Copy link
Member

@dolfinus dolfinus commented Nov 14, 2025

Change Summary

Reuse Spark docker entrypoint to start worker container. This allows to use the same environment for both Spark driver (inside SyncMaster worker container) and for Spark executors.

Related issue number

Checklist

  • Commit message and PR title is comprehensive
  • Keep the change as small as possible
  • Unit and integration tests for the changes exist
  • Tests pass on CI and coverage does not decrease
  • Documentation reflects the changes where applicable
  • docs/changelog/next_release/<pull request or issue id>.<change type>.rst file added describing change
    (see CONTRIBUTING.rst for details.)
  • My PR is ready to review.

@dolfinus dolfinus changed the title [DOP-30579] Allow using SyncMaster worker image as spark.kubernetes.c… [DOP-30579] Allow using SyncMaster worker image as spark.kubernetes.container.image Nov 14, 2025
@github-actions
Copy link

Coverage

Coverage Report •
FileStmtsMissCoverMissing
syncmaster/worker
   spark.py79297%132–133
TOTAL512128794% 

@dolfinus dolfinus requested review from TiGrib and marashka November 17, 2025 08:10
@dolfinus dolfinus merged commit 791d562 into develop Nov 17, 2025
24 of 25 checks passed
@dolfinus dolfinus deleted the feature/DOP-30579 branch November 17, 2025 10:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants