Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

What changes were proposed in this pull request?

This is a backport of #44813 .

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

BEFORE

  • Minikube: v1.30.1
  • K8s: v1.26.3

AFTER

  • Minikube: v1.32.0
  • K8s: v1.28.3

Why are the changes needed?

  • Previously, it was pinned due to the failure.
  • After this PR, we will track the latest Minikube and K8s version always.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

**BEFORE**
- Minikube: v1.30.1
- K8s: v1.26.3

**AFTER**
- Minikube: v1.32.0
- K8s: v1.28.3

- Previously, it was pinned due to the failure.
- After this PR, we will track the latest Minikube and K8s version always.

No.

Pass the CIs.

No.

Closes apache#44813 from dongjoon-hyun/SPARK-44495.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: yangjie01 <[email protected]>
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-44495][INFRA][K8S][3.5] Use the latest minikube in K8s IT [SPARK-44495][INFRA][K8S][3.4] Use the latest minikube in K8s IT Jan 21, 2024
@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Jan 21, 2024

All tests including K8s IT passed. Could you review this branch-3.4 backporting PR, @LuciferYang ?

Screenshot 2024-01-20 at 8 06 32 PM

@dongjoon-hyun
Copy link
Member Author

Since this is a infra only PR, let me merge this to recover branch-3.4.

dongjoon-hyun added a commit that referenced this pull request Jan 21, 2024
### What changes were proposed in this pull request?

This is a backport of #44813 .

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

**BEFORE**
- Minikube: v1.30.1
- K8s: v1.26.3

**AFTER**
- Minikube: v1.32.0
- K8s: v1.28.3

### Why are the changes needed?

- Previously, it was pinned due to the failure.
- After this PR, we will track the latest Minikube and K8s version always.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #44820 from dongjoon-hyun/SPARK-44495-3.4.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-44495-3.4 branch January 21, 2024 08:19
@LuciferYang
Copy link
Contributor

late LGTM

szehon-ho pushed a commit to szehon-ho/spark that referenced this pull request Feb 7, 2024
This is a backport of apache#44813 .

This PR aims to recover GitHub Action K8s IT to use the latest Minikube and to make it sure that Apache Spark K8s module are tested with all Minikubes without any issues.

**BEFORE**
- Minikube: v1.30.1
- K8s: v1.26.3

**AFTER**
- Minikube: v1.32.0
- K8s: v1.28.3

- Previously, it was pinned due to the failure.
- After this PR, we will track the latest Minikube and K8s version always.

No.

Pass the CIs.

No.

Closes apache#44820 from dongjoon-hyun/SPARK-44495-3.4.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants