-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-22496][SQL] thrift server adds operation logs #19961
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
## What changes were proposed in this pull request? since hive 2.0+ upgrades log4j to log4j2,a lot of [changes](https://issues.apache.org/jira/browse/HIVE-11304) are made working on it. as spark is not to ready to update its inner hive version(1.2.1) , so I manage to make little changes. the function registerCurrentOperationLog is moved from SQLOperstion to its parent class ExecuteStatementOperation so spark can use it. ## How was this patch tested? manual test Author: zouchenjun <[email protected]> Closes apache#19721 from ChenjunZou/operation-log.
|
ok to test |
| if (isOperationLogEnabled) { | ||
| if (operationLog == null) { | ||
| LOG.warn("Failed to get current OperationLog object of Operation: " + | ||
| getHandle().getHandleIdentifier()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think the indentation should be double spaced.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This was resolved by me when I did the merge.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @gatorsmile.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @gatorsmile @HyukjinKwon
|
Test build #84825 has finished for PR 19961 at commit
|
|
ok to test |
|
Test build #84933 has finished for PR 19961 at commit
|
|
LGTM Thanks! Merged to master. |
|
Now, SparkR started failing, after we remerge this PR. It sounds like it is related to the merge of this PR. I have to revert it. Sorry for that. |
|
It indeed looked somehow related as the CRAN was broken at the similar time. BTW, seems unrelated at the end. Let me bring it back. |
What changes were proposed in this pull request?
since hive 2.0+ upgrades log4j to log4j2,a lot of changes are made working on it.
as spark is not to ready to update its inner hive version(1.2.1) , so I manage to make little changes.
the function registerCurrentOperationLog is moved from SQLOperstion to its parent class ExecuteStatementOperation so spark can use it.
How was this patch tested?
manual test
Closes #19721 from ChenjunZou/operation-log.