Skip to content

Operator 0.1.0 #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jiangzho wants to merge 15 commits into from
Closed

Operator 0.1.0 #2

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
233c145
Operator 1.0.0-alpha
jiangzho Apr 1, 2024
89d52c7
Update supported Spark and JDK version, with multiple style fix and d…
jiangzho Apr 4, 2024
734a48b
Style fix: indent and imports
jiangzho Apr 4, 2024
85c623e
Update runtime JDK version to 17, upgrade Spark and slf4j version.
jiangzho Apr 5, 2024
d0db806
Remove deprecated Spark versions, and update JDK version for build
jiangzho Apr 5, 2024
33325e7
Remove deprecated versions from example & update generated CRD
jiangzho Apr 5, 2024
bae3e14
Fully qualify the property names.
jiangzho Apr 8, 2024
91bc916
Support resource retention policy for apps.
jiangzho Apr 9, 2024
f0a2e74
Fix deprecated versions in doc & remove unused.
jiangzho Apr 9, 2024
39a74e1
remove auto generated CRD and add docs to generate it.
jiangzho Apr 9, 2024
d448092
update docs for generating crd
jiangzho Apr 9, 2024
4bf6d59
Remove redundant mdc keys and rename to match josdk mdc pattern
jiangzho Apr 17, 2024
689c4f9
Merge conflicts from upstream
jiangzho Apr 18, 2024
8ec7d73
Update operator version and gradle version used in builder
jiangzho Apr 18, 2024
110e1a8
Rename inconsistent class prefix to SparkApp, and misc clean up.
jiangzho Apr 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
update docs for generating crd
  • Loading branch information
@jiangzho
jiangzho committed Apr 9, 2024
commit d4480921b72331e4d835d43c35597d9af7e11006
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,3 +64,4 @@ build/
**/generated
lib
target
build-tools/helm/spark-kubernetes-operator/crds/
5 changes: 0 additions & 5 deletions build-tools/helm/spark-kubernetes-operator/.helmignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,6 @@
# Common VCS dirs
.git/
.gitignore
.bzr/
.bzrignore
.hg/
.hgignore
.svn/
# Common backup files
*.swp
*.bak
Expand Down
7 changes: 5 additions & 2 deletions spark-operator-docs/getting_started.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,13 +46,16 @@ minikube start
eval $(minikube docker-env)
```

### Build Spark Operator Image Locally
### Build Spark Operator Locally

```bash
# Build a local container image which can be used for minikube.etc.
# For testing in remote k8s cluster, please also do `docker push` to make it available
# to the cluster / nodes
docker build --build-arg BASE_VERSION=1.0.0-alpha -t spark-kubernetes-operator:1.0.0-alpha .
docker build --build-arg BASE_VERSION=1.0.0-alpha -t spark-kubernetes-operator:1.0.0-alpha .

# Generate CRD yaml and make it available for chart deployment
./gradlew spark-operator-api:copyGeneratedCRD
Copy link

@zwangsheng zwangsheng Apr 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should try to mention some preliminaries in this local, such as installing helm and yq.

```
### Install the Spark Operator

Expand Down