Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

What changes were proposed in this pull request?

This is a backport of #44813 .

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

BEFORE

  • Minikube: v1.30.1
  • K8s: v1.26.3

AFTER

  • Minikube: v1.32.0
  • K8s: v1.28.3

Why are the changes needed?

  • Previously, it was pinned due to the failure.
  • After this PR, we will track the latest Minikube and K8s version always.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

**BEFORE**
- Minikube: v1.30.1
- K8s: v1.26.3

**AFTER**
- Minikube: v1.32.0
- K8s: v1.28.3

- Previously, it was pinned due to the failure.
- After this PR, we will track the latest Minikube and K8s version always.

No.

Pass the CIs.

No.

Closes apache#44813 from dongjoon-hyun/SPARK-44495.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: yangjie01 <[email protected]>
@dongjoon-hyun
Copy link
Member Author

Since SPARK-44495 is in Apache Spark 3.5.0 too, I made a backport, @LuciferYang .

dongjoon-hyun added a commit that referenced this pull request Jan 21, 2024
### What changes were proposed in this pull request?

This is a backport of #44813 .

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

**BEFORE**
- Minikube: v1.30.1
- K8s: v1.26.3

**AFTER**
- Minikube: v1.32.0
- K8s: v1.28.3

### Why are the changes needed?

- Previously, it was pinned due to the failure.
- After this PR, we will track the latest Minikube and K8s version always.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #44819 from dongjoon-hyun/SPARK-44495-3.5.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun
Copy link
Member Author

Merged to branch-3.5 for Apache Spark 3.5.1.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-44495-3.5 branch January 21, 2024 02:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants