Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed #2818

Closed
wants to merge 1 commit into from

Conversation

zjffdu
Copy link
Contributor

@zjffdu zjffdu commented Feb 26, 2018

What is this PR for?

Add one new property zeppelin.livy.restart_dead_session to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves.

What type of PR is it?

[Feature]

Todos

  • - Task

What is the Jira issue?

How should this be tested?

  • Manually tested.

Screenshots (if appropriate)

image

Questions:

  • Does the licenses files need update? No
  • Is there breaking changes for older versions? No
  • Does this needs documentation? No

…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed
asfgit pushed a commit that referenced this pull request Feb 26, 2018
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed

### What is this PR for?
Add one new property `zeppelin.livy.restart_dead_session` to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves.

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3246

### How should this be tested?
* Manually tested.

### Screenshots (if appropriate)
![image](https://user-images.githubusercontent.com/164491/36651529-4a22ab36-1ae4-11e8-88dc-23a814e4c1b1.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #2818 from zjffdu/ZPPELIN-3246 and squashes the following commits:

89d44f6 [Jeff Zhang] ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed

(cherry picked from commit 75ada89)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>
@asfgit asfgit closed this in 75ada89 Feb 26, 2018
SleepyThread pushed a commit to SleepyThread/zeppelin that referenced this pull request Feb 27, 2018
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed

### What is this PR for?
Add one new property `zeppelin.livy.restart_dead_session` to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves.

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3246

### How should this be tested?
* Manually tested.

### Screenshots (if appropriate)
![image](https://user-images.githubusercontent.com/164491/36651529-4a22ab36-1ae4-11e8-88dc-23a814e4c1b1.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes apache#2818 from zjffdu/ZPPELIN-3246 and squashes the following commits:

89d44f6 [Jeff Zhang] ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed
@bikassaha
Copy link

Can this be specified on a per notebook basis using the %conf interpreter? It may be difficult to turn this on globally because of the various reasons why sessions may die.

Would it be better for the error message to ask the user to restart the interpreter from the notebook page itself?

@zjffdu
Copy link
Contributor Author

zjffdu commented Mar 6, 2018

For whatever interpreter setting, user can set it via %conf.

When zeppelin.livy.restart_dead_session is turned on. dead livy session will be restarted automatically.
When it is turned off, proper message will be displayed in frontend, user can restart livy interpreter by himself after seeing this message.

And by default it is turned off, we encourage user to investigate why livy session is dead instead of restarting it for users.

@bikassaha
Copy link

zeppelin.livy.restart_dead_session - Is this an interpreter level setting? Will it start only that users livy session?

@zjffdu
Copy link
Contributor Author

zjffdu commented Mar 6, 2018

It would only restart that users livy session.

jwagun pushed a commit to jwagun/zeppelin that referenced this pull request Apr 23, 2018
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed

### What is this PR for?
Add one new property `zeppelin.livy.restart_dead_session` to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves.

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3246

### How should this be tested?
* Manually tested.

### Screenshots (if appropriate)
![image](https://user-images.githubusercontent.com/164491/36651529-4a22ab36-1ae4-11e8-88dc-23a814e4c1b1.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes apache#2818 from zjffdu/ZPPELIN-3246 and squashes the following commits:

89d44f6 [Jeff Zhang] ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants