Skip to content

[SPARK-52297] Add Swift-based SparkPi K8s Job example#227

Closed
dongjoon-hyun wants to merge 1 commit intoapache:mainfrom
dongjoon-hyun:SPARK-52297
Closed

[SPARK-52297] Add Swift-based SparkPi K8s Job example#227
dongjoon-hyun wants to merge 1 commit intoapache:mainfrom
dongjoon-hyun:SPARK-52297

Conversation

@dongjoon-hyun
Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun commented May 24, 2025

What changes were proposed in this pull request?

This PR aims to add Swift-based SparkPi K8s Job example.

Why are the changes needed?

To provide a working example with

Does this PR introduce any user-facing change?

No behavior change because this is a new example.

How was this patch tested?

Manual tests.

# Install Spark K8s Operator
$ helm install spark spark/spark-kubernetes-operator

# Launch Spark 4.0 Connect Server
$ kubectl apply -f examples/spark-connect-server.yaml

# Launch `Swift-based SparkPi` Application
$ kubectl  apply -f examples/job/pi-swift.yaml

# Check the log
$ kubectl logs -f job/spark-connect-swift-pi
Pi is roughly 3.142923142923143

Was this patch authored or co-authored using generative AI tooling?

No.

spec:
containers:
- name: job
image: dongjoon/spark-connect-swift:pi
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When spark-connect-swift gets the repository, this will be replaced with the official one.

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

cc @viirya , @peter-toth , @jiangxb1987

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-52297] Add Swift-based SparkPi K8s Job example [SPARK-52297] Add Swift-based SparkPi K8s Job example May 24, 2025
@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Thank you so much, @viirya !
Merged to main.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-52297 branch May 24, 2025 23:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants