New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed #2818
Conversation
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed ### What is this PR for? Add one new property `zeppelin.livy.restart_dead_session` to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3246 ### How should this be tested? * Manually tested. ### Screenshots (if appropriate) ![image](https://user-images.githubusercontent.com/164491/36651529-4a22ab36-1ae4-11e8-88dc-23a814e4c1b1.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #2818 from zjffdu/ZPPELIN-3246 and squashes the following commits: 89d44f6 [Jeff Zhang] ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed (cherry picked from commit 75ada89) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed ### What is this PR for? Add one new property `zeppelin.livy.restart_dead_session` to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3246 ### How should this be tested? * Manually tested. ### Screenshots (if appropriate) ![image](https://user-images.githubusercontent.com/164491/36651529-4a22ab36-1ae4-11e8-88dc-23a814e4c1b1.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2818 from zjffdu/ZPPELIN-3246 and squashes the following commits: 89d44f6 [Jeff Zhang] ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed
Can this be specified on a per notebook basis using the %conf interpreter? It may be difficult to turn this on globally because of the various reasons why sessions may die. Would it be better for the error message to ask the user to restart the interpreter from the notebook page itself? |
For whatever interpreter setting, user can set it via %conf. When And by default it is turned off, we encourage user to investigate why livy session is dead instead of restarting it for users. |
zeppelin.livy.restart_dead_session - Is this an interpreter level setting? Will it start only that users livy session? |
It would only restart that users livy session. |
…eter automatically as zeppelin does not start new Livy session if yarn livy session application is killed ### What is this PR for? Add one new property `zeppelin.livy.restart_dead_session` to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3246 ### How should this be tested? * Manually tested. ### Screenshots (if appropriate) ![image](https://user-images.githubusercontent.com/164491/36651529-4a22ab36-1ae4-11e8-88dc-23a814e4c1b1.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2818 from zjffdu/ZPPELIN-3246 and squashes the following commits: 89d44f6 [Jeff Zhang] ZEPPELIN-3246. Need option for automatically restart the livy interpreter automatically as zeppelin does not start new Livy session if yarn livy session application is killed
What is this PR for?
Add one new property
zeppelin.livy.restart_dead_session
to allow livy session to be created automatically. By default it is false, because there's many reason that session is dead, it is encouraged to ask user to check why it is dead and restart interpreter by themselves.What type of PR is it?
[Feature]
Todos
What is the Jira issue?
How should this be tested?
Screenshots (if appropriate)
Questions: