Skip to content

Conversation

@zedtang
Copy link
Collaborator

@zedtang zedtang commented Nov 3, 2024

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (Infra)

Description

Add a python linter script to enforce new code to adhere to structured logging. There is a similar effort in Spark: apache/spark#47239.

How was this patch tested?

github workflow passed.

Does this PR introduce any user-facing changes?

No

@zedtang zedtang changed the title initial commit [INFRA] Add structured logging linter script to github workflow Nov 4, 2024
pipenv run pip install pyarrow==8.0.0
pipenv run pip install numpy==1.20.3
if: steps.git-diff.outputs.diff
- name: Scala structured logging check
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"check" is ambiguous. "style check"?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rename to spark_structured_logging_style.py

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@zedtang zedtang force-pushed the add-structured-logging-style-check branch from ecd1b89 to db6cd7e Compare November 4, 2024 22:24
@scottsand-db scottsand-db merged commit c60437b into delta-io:master Nov 5, 2024
16 of 19 checks passed
@zedtang zedtang deleted the add-structured-logging-style-check branch November 5, 2024 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants