feat: add SparkClient API for SparkConnect session management#225

Merged

google-oss-prow[bot] merged 14 commits intokubeflow:mainfrom

Shekharrajak:feat/sparkclient-mvp

Feb 12, 2026

Commits on Feb 9, 2026

feat(spark): add core types, dataclasses, and constants
Shekharrajak
committed
feat(spark): add backend base class and options pattern
Shekharrajak
committed
feat(spark): add KubernetesBackend for SparkConnect CRD operations
Shekharrajak
committed
feat(spark): add SparkClient API with KEP-107 compliant connect method
Shekharrajak
committed
chore(spark): add test infrastructure and package init files
Shekharrajak
committed
feat(spark): add example scripts demonstrating SparkClient usage
Shekharrajak
committed
docs(spark): add documentation for SparkClient and E2E testing
Shekharrajak
committed
test(spark): add E2E test framework with cluster watcher
Shekharrajak
committed
ci(spark): add GitHub Actions workflow and E2E cluster setup
Shekharrajak
committed
chore(spark): add pyspark[connect] dependency and update lock file
Shekharrajak
committed
Update kubeflow/spark/backends/base.py

Shekharrajak
and
andreyvelich
authored
refactor(spark): rename backend.connect_session() to connect()
Shekharrajak
committed

Commits on Feb 10, 2026

refactor: move session creation flow from SparkClient to backend.create_and_connect()
Shekharrajak
committed

Commits on Feb 12, 2026

Merge upstream/main into feat/sparkclient-mvp
Shekharrajak
committed