Skip to content

Operator 0.1.0 #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jiangzho wants to merge 15 commits into from
Closed

Operator 0.1.0 #2

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
233c145
Operator 1.0.0-alpha
jiangzho Apr 1, 2024
89d52c7
Update supported Spark and JDK version, with multiple style fix and d…
jiangzho Apr 4, 2024
734a48b
Style fix: indent and imports
jiangzho Apr 4, 2024
85c623e
Update runtime JDK version to 17, upgrade Spark and slf4j version.
jiangzho Apr 5, 2024
d0db806
Remove deprecated Spark versions, and update JDK version for build
jiangzho Apr 5, 2024
33325e7
Remove deprecated versions from example & update generated CRD
jiangzho Apr 5, 2024
bae3e14
Fully qualify the property names.
jiangzho Apr 8, 2024
91bc916
Support resource retention policy for apps.
jiangzho Apr 9, 2024
f0a2e74
Fix deprecated versions in doc & remove unused.
jiangzho Apr 9, 2024
39a74e1
remove auto generated CRD and add docs to generate it.
jiangzho Apr 9, 2024
d448092
update docs for generating crd
jiangzho Apr 9, 2024
4bf6d59
Remove redundant mdc keys and rename to match josdk mdc pattern
jiangzho Apr 17, 2024
689c4f9
Merge conflicts from upstream
jiangzho Apr 18, 2024
8ec7d73
Update operator version and gradle version used in builder
jiangzho Apr 18, 2024
110e1a8
Rename inconsistent class prefix to SparkApp, and misc clean up.
jiangzho Apr 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update operator version and gradle version used in builder
  • Loading branch information
@jiangzho
jiangzho committed Apr 18, 2024
commit 8ec7d7317a239d4aa4456d71713caa12adae3c09
2 changes: 1 addition & 1 deletion Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
#
#

FROM gradle:8.6-jdk17-alpine AS builder
FROM gradle:8.7-jdk17-alpine AS builder
ARG BASE_VERSION
WORKDIR /app
COPY . .
Expand Down
4 changes: 2 additions & 2 deletions build-tools/helm/spark-kubernetes-operator/Chart.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,5 @@ apiVersion: v2
name: spark-kubernetes-operator
description: A Helm chart for the Apache Spark Kubernetes Operator
type: application
version: 1.0.0-alpha
appVersion: 1.0.0-alpha
version: 0.1.0
appVersion: 0.1.0
2 changes: 1 addition & 1 deletion gradle.properties
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
#
#
group=org.apache.spark.kubernetes.operator
version=1.0.0-alpha
version=0.1.0
commonsLang3Version=3.12.0
commonsIOVersion=2.11.0
commonsConfigurationVersion=2.9.0
Expand Down
2 changes: 1 addition & 1 deletion spark-operator-docs/developer_guide.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ If you are working on API (CRD) changes, remember to update CRD yaml in chart as
# Build a local container image which can be used for minikube.etc.
# For testing in remote k8s cluster, please also do `docker push` to make it available
# to the cluster / nodes
docker build --build-arg BASE_VERSION=1.0.0-alpha -t spark-kubernetes-operator:1.0.0-alpha .
docker build --build-arg BASE_VERSION=0.1.0 -t spark-kubernetes-operator:0.1.0 .
```

## Deploy Operator
Expand Down
4 changes: 2 additions & 2 deletions spark-operator-docs/getting_started.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ cluster.

### Compatibility

- JDK11, 17, or 23
- JDK17, or 23
- Operator used fabric8 which assumes to be compatible with available k8s versions.
- Spark versions 3.4 and above

Expand All @@ -52,7 +52,7 @@ eval $(minikube docker-env)
# Build a local container image which can be used for minikube.etc.
# For testing in remote k8s cluster, please also do `docker push` to make it available
# to the cluster / nodes
docker build --build-arg BASE_VERSION=1.0.0-alpha -t spark-kubernetes-operator:1.0.0-alpha .
docker build --build-arg BASE_VERSION=0.1.0 -t spark-kubernetes-operator:0.1.0 .

# Generate CRD yaml and make it available for chart deployment
./gradlew spark-operator-api:copyGeneratedCRD
Copy link

@zwangsheng zwangsheng Apr 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should try to mention some preliminaries in this local, such as installing helm and yq.

Expand Down