-
Notifications
You must be signed in to change notification settings - Fork 599
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[LIVY-566] When cancel a sql job through livy, actually the sparkjob still running #151
Conversation
@@ -59,7 +59,7 @@ public SqlJob( | |||
|
|||
@Override | |||
public Void call(JobContext ctx) throws Exception { | |||
ctx.sc().setJobGroup(statementId, statement); | |||
ctx.sc().setJobGroup(statementId, statement) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is setting job description as statement text related to LIVY-566?
If yes, job description might need to be set to something else? as statement text can contain sensitive information.
Thanks.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The particular change you're commenting on is not part of this PR. In fact this PR does not compile, because this change is wrong...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please explain the fix in the PR title, not the problem.
And please cleanup the PR template from your description.
@@ -60,6 +58,8 @@ class LivyExecuteStatementOperation( | |||
|
|||
private def statementId: String = opHandle.getHandleIdentifier.toString | |||
|
|||
private var jobHandle: JobHandle[_]=_ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add spaces around =
. Also later.
But really I think the correct fix would be in ThriftSessionState.cleanupStatement
. Seems I missed to port some code from the old implementation when creating that class: 39fa887#diff-712ea78474e0573e4dbe90b46f67ff05L160
Closing due to no reply. I'll post my own fix. |
What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/LIVY-566
(Please fill in changes proposed in this fix)
(Include a link to the associated JIRA and make sure to add a link to this pr on the JIRA as well)
How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Please review https://livy.incubator.apache.org/community/ before opening a pull request.