Skip to content

Comments

[Spark] Support spark-operator on multi-namespace deployments#258

Open
alxtkr77 wants to merge 2 commits intomlrun:developmentfrom
alxtkr77:CEML-540
Open

[Spark] Support spark-operator on multi-namespace deployments#258
alxtkr77 wants to merge 2 commits intomlrun:developmentfrom
alxtkr77:CEML-540

Conversation

@alxtkr77
Copy link
Member

@alxtkr77 alxtkr77 commented Feb 16, 2026

Summary

  • Admin namespace holds CRDs + ClusterRole with no running pods (replicas=0), each user namespace runs its own spark-operator controller with a namespace-scoped RoleBinding to the shared ClusterRole
  • Adds CE-level spark config section to decouple ConfigMap rendering from subchart enablement
  • Adds spark-controller-rbac.yaml CE template that creates RoleBinding → ClusterRole + leader election RBAC in user namespaces
  • Updates admin/non-admin/cluster-ip values files with spark-operator split configuration
  • Adds multi-ns Kind test command validating admin + 2 user namespaces with RBAC and functional SparkApplication checks
  • Bumps chart version to 0.11.0-rc10

Test plan

  • make helm-lint passes (including new check-version-bump target)
  • helm template renders correctly for single-NS, admin, and non-admin modes
  • tests/kind-test.sh full — single-NS regression with spark webhook mutation checks
  • tests/kind-test.sh multi-ns — admin/user split with RBAC and functional SparkApplication checks
  • Manual validation on vmdev10ig4 cluster

🤖 Generated with Claude Code

@alxtkr77 alxtkr77 force-pushed the CEML-540 branch 11 times, most recently from 1ee039f to bd25f15 Compare February 23, 2026 10:47
Alex Toker and others added 2 commits February 23, 2026 11:09
Admin namespace holds CRDs + ClusterRole (no running pods), each user
namespace runs its own spark-operator controller with a namespace-scoped
RoleBinding to the shared ClusterRole.

- Add CE-level `spark` config section to decouple ConfigMap from subchart
- Add spark-controller-rbac.yaml template for user NS RBAC gap
- Update admin/non-admin values files with spark-operator split config
- Add `multi-ns` command to Kind test with 2 user namespace validation
- Bump chart version to 0.11.0-rc9
ct lint's semver comparison treats rc10 < rc9 (string comparison of
prerelease identifiers). Replace with sort -V based check that handles
rcN numbering correctly.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
@alxtkr77 alxtkr77 marked this pull request as ready for review February 23, 2026 11:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant