[ZEPPELIN-4600] nullpoint error in the long time process use api to run a note #3649
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
### What is this PR for? Straightforward bugfix for ZEPPELIN-3278. Just don't create interpreter setting instance when registering from template. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3278 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2824 from zjffdu/ZEPPELIN-3278 and squashes the following commits: 6ece9ca [Jeff Zhang] [ZEPPELIN-3278] Avoid duplicated interpreter setting (cherry picked from commit 21dc20d) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? This is a hotfix PR for branch-0.8 build ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * No jira created ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2830 from zjffdu/Hotfix_0.8 and squashes the following commits: 59c2af4 [Jeff Zhang] [HOTFIX] Fix branch-0.8 build
### What is this PR for? When it is LocalConfigStorage, we should use getRelativePath to get the config path. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3281 ### How should this be tested? * Unit test added ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2831 from zjffdu/ZEPPELIN-3281 and squashes the following commits: 3438577 [Jeff Zhang] ZEPPELIN-3281. Apply getRelativePath when it is LocalConfigStorage (cherry picked from commit bfc93dc) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? New interpreter, SAP BusinessObjects (Universes). See [documentation](https://github.com/masyan/zeppelin/blob/9178d1cc80253b9ae58b988443b619127f42d945/docs/interpreter/sap.md) ### What type of PR is it? [Feature] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3194 ### How should this be tested? see screenshots ### Screenshots (if appropriate) Autocomplete + get results  Errors  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Maksim Reshetov <jmasyan@gmail.com> Closes apache#2763 from masyan/ZEPPELIN-3194 and squashes the following commits: 696b7dd [Maksim Reshetov] Merge remote-tracking branch 'upstream/master' into ZEPPELIN-3194 1e25fd1 [Maksim Reshetov] [ZEPPELIN-3194] refactor parser os query. add tests 24336a8 [Maksim Reshetov] [ZEPPELIN-3194] fix parser for result objects and conditions 9178d1c [Maksim Reshetov] [ZEPPELIN-3194] docs ce97551 [Maksim Reshetov] Merge remote-tracking branch 'upstream/master' into ZEPPELIN-3194 0784ba0 [Maksim Reshetov] [ZEPPELIN-3194] docs e00ace2 [Maksim Reshetov] [ZEPPELIN-3194] completer tests 1aeb7ad [Maksim Reshetov] [ZEPPELIN-3194] pom license c1c09af [Maksim Reshetov] [ZEPPELIN-3194] docs fix + unit tests for util f6b71f9 [Maksim Reshetov] [ZEPPELIN-3194] is null fix (cherry picked from commit 63c53fc) Signed-off-by: Lee moon soo <moon@apache.org>
…terResultMessages() ### What is this PR for? Remove Redundant method `InterpreterOutput.getInterpreterResultMessages()` ### What type of PR is it? Refactoring ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3283 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes apache#2828 from Leemoonsoo/ZEPPELIN-3283 and squashes the following commits: 12771a1 [Lee moon soo] remove unused import 82bda9c [Lee moon soo] Remove redundant method getInterpreterResultMessages() (cherry picked from commit 66dada6) Signed-off-by: Lee moon soo <moon@apache.org>
…hon interpreter
### What is this PR for?
```
%python
import time
print("Hello")
time.sleep(0.5) # in case of Ipython kernel, print may not immediately flushed and cleared.
z.getInterpreterContext().out().clear()
print("world")
```
Expected to print `world` only.
This worked in zeppelin-0.7.x and it'll be nice keep this feature in the future version.
### What type of PR is it?
Bug fix | Improvement
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-3284
### How should this be tested?
* First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration
* Strongly recommended: add automated unit tests for any new or changed behavior
* Outline any manual steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: Lee moon soo <moon@apache.org>
Closes apache#2829 from Leemoonsoo/ZEPPELIN-3284 and squashes the following commits:
e0dcda6 [Lee moon soo] make z.getInterpreterContext().out().clear() work in IPythonInterprete
224a2df [Lee moon soo] make z.getInterpreterContext().out().clear() work in PythonInterpreter
(cherry picked from commit d90716d)
Signed-off-by: Lee moon soo <moon@apache.org>
…sions of spark This PR is trying to add test for one build of zeppelin to work with multiple versions of spark. There's 2 main system test * `SparkIntegrationTest` ( It launches spark interpreter from interpreter setting component in 3 modes: local, yarn-client, yarn-cluster) * `ZeppelinSparkClusterTest` (It launch spark interpreter in local mode from Paragraph side [Improvement] * [ ] - Task * https://issues.apache.org/jira/browse/ZEPPELIN-3254 * CI pass * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2832 from zjffdu/ZEPPELIN-3254 and squashes the following commits: 3b06ed9 [Jeff Zhang] ZEPPELIN-3254. Enable one build of zeppelin to work with multiple versions of spark (cherry picked from commit d6cdd56) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…Factory.getInterpreter ### What is this PR for? Minor code refactoring to throw exception when no interpreter is found ### What type of PR is it? [Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3291 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2836 from zjffdu/ZEPPELIN-3291 and squashes the following commits: bee319c [Jeff Zhang] ZEPPELIN-3291. Throw exception instead of return null for InterpreterFactory.getInterpreter (cherry picked from commit e148c8c) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
… binded to this note' ### What is this PR for? I observed IndexOutOfBoundsException when using zeppelin locally on an existing notebook repository and with fresh interpreter.json file. The default Zeppelin behavior when using existing notebooks is the manual binding of the interpreter settings, which works fine. This PR simply avoids the IndexOutOfBoundsException. ### What type of PR is it? Bug Fix ### Todos - ### What is the Jira issue? [https://issues.apache.org/jira/browse/ZEPPELIN-3243](https://issues.apache.org/jira/browse/ZEPPELIN-3243) ### How should this be tested? - manual ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Andreas Weise <a.weise@avm.de> Closes apache#2808 from weand/ZEPPELIN-3243 and squashes the following commits: b97a38e [Andreas Weise] ZEPPELIN-3243 fix IndexOutOfBoundsException when 'No interpreter is binded to this note' (cherry picked from commit fe660ab) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…eOnUnbindInterpreterSetting ### What is this PR for? The root cause of this flaky test is that hashCode doesn't represent an unique id of object. This PR just use IdGenerator for unique id and also combine process id. This PR also fix the flaky test caused by matplotlib. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3279 ### How should this be tested? * CI Pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2837 from zjffdu/ZEPPELIN-3279 and squashes the following commits: 063d4ee [Jeff Zhang] ZEPPELIN-3279. [FlakyTest] NotebookTest.testPerSessionInterpreterCloseOnUnbindInterpreterSetting (cherry picked from commit a6cd0e2) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…tToWebsocketWhoFireTheEvent fails ### What is this PR for? Trivial fix for flaky test, see the comment for details. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3277 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2838 from zjffdu/ZEPPELIN-3277 and squashes the following commits: 68827d7 [Jeff Zhang] ZEPPELIN-3277. NotebookServerTest.testMakeSureNoAngularObjectBroadcastToWebsocketWhoFireTheEvent fails (cherry picked from commit c77c549) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…ap interpreter ### What is this PR for? Hotfix PR for branch-0.8 build ### What type of PR is it? [Hot Fix] ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3300 ### How should this be tested? CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Andreas Weise <a.weise@avm.de> Closes apache#2842 from weand/ZEPPELIN-3300 and squashes the following commits: bbb5cce [Andreas Weise] ZEPPELIN-3300 hotfix branch-0.8: 0.9.0-SNAPSHOT dependency in sap/pom.xml
### What is this PR for? Trivial PR to remove the build of profile spark-1.6 and scala-2.11, The travis build of profile spark-1.6 and scala-2.11 only test the embedded mode of spark instead real spark binary distribution of spark 1.6 with scala-2.11, so IMHO it is safe for us to just remove that build and only keep spark 1.6 with scala-2.10 ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3295 ### How should this be tested? * Travis CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2840 from zjffdu/ZEPPELIN-3295 and squashes the following commits: 946cf5d [Jeff Zhang] ZEPPELIN-3295. Remove build of profile spark-1.6 and scala-2.11 (cherry picked from commit 0cff6f0) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? Just refactor livy integration test to minuze livy session so that we can reduce the livy build time. ### What type of PR is it? [Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3296 ### How should this be tested? * Travis CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2844 from zjffdu/ZEPPELIN-3296 and squashes the following commits: 206ea3e [Jeff Zhang] ZEPPELIN-3296. Reorg livy integration test to minimize livy session (cherry picked from commit 483dc3f) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…ne build ### What is this PR for? In ZEPPELIN-3254, we introduce 2 build for spark integration test. And we can run unit test with these system test together so that we could save 2 build in travis and also save time to set up enviroment. ### What type of PR is it? [Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3299 ### How should this be tested? * Travis CI Pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2843 from zjffdu/ZEPPELIN-3299 and squashes the following commits: dcbbb10 [Jeff Zhang] ZEPPELIN-3299. Combine spark integration test with its unit test in one build (cherry picked from commit 733a202) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? Trivial PR to support 2.3 via updating SparkVersion.java. Unfortunately we cannot download spark 2.3 from http://d3kbcqa49mib13.cloudfront.net, will leave it in ZEPPELIN-3305 ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3302 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2846 from zjffdu/ZEPPELIN-3302-2 and squashes the following commits: 212eb68 [Jeff Zhang] ZEPPELIN-3302. Update SparkVersion.java to support Spark 2.3 (cherry picked from commit db37746) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? 1. Move sap module before zeppelin-distribution, otherwise sap module will be built after zeppelin-distribution 2. Fix code style issue of sap module 3. Update travis to include sap module ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3304 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2845 from zjffdu/ZEPPELIN-3304 and squashes the following commits: 533a1b0 [Jeff Zhang] ZEPPELIN-3304. Move sap module before zeppelin-distribution (cherry picked from commit a3952ea) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? It is not necessary to download spark distribution for several travis build. This PR would remove that to save time. ### What type of PR is it? [ Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3303 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2847 from zjffdu/ZEPPELIN-3303 and squashes the following commits: b5c4049 [Jeff Zhang] ZEPPELIN-3303. Avoid download spark for travis build (cherry picked from commit 2afcb94) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…aph mid-run ### What is this PR for? Trivial fix that just skip the disable paragraph when run all paragraphs. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3286 ### How should this be tested? * Manually tested ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2833 from zjffdu/ZEPPELIN-3286 and squashes the following commits: 924d1fc [Jeff Zhang] ZEPPELIN-3286. Run All Paragraphs stops if there is a disabled paragraph mid-run (cherry picked from commit c904e56) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…s been changed Changing paragraph height does not work correctly anymore in conjunction with table output. Refer screen shot:  [Bug Fix] * [ZEPPELIN-3289](https://issues.apache.org/jira/browse/ZEPPELIN-3289) * [ZEPPELIN-3272](https://issues.apache.org/jira/browse/ZEPPELIN-3272) * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes apache#2835 from prabhjyotsingh/ZEPPELIN-3289 and squashes the following commits: 4032260 [Prabhjyot Singh] data duplication fix d63c5e7 [Prabhjyot Singh] fix `core` undefined dd6a6d1 [Prabhjyot Singh] ZEPPELIN-3289: refresh() also updates height Change-Id: I4056f796cd34cf23af12dcf4af6ee9c3ae6067e7 (cherry picked from commit 0267ecf) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
… to permissions ### What is this PR for? This PR fixes a bug when unnecessary spaces are added to the permissions. ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-3180](https://issues.apache.org/jira/browse/ZEPPELIN-3180) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Savalek <def113@mail.ru> Closes apache#2749 from Savalek/ZEPPELIN-3180 and squashes the following commits: b24f1d4 [Savalek] Merge branch 'master' into ZEPPELIN-3180 b2f58fb [Savalek] Merge remote-tracking branch 'upstream/master' into ZEPPELIN-3180 84ee2cb [Savalek] Merge remote-tracking branch 'upstream/master' into ZEPPELIN-3180 28c537e [Savalek] [ZEPPELIN-3212] add test 0d4a900 [Savalek] [ZEPPELIN-3180] FIX - interpreter add whitespace to permissions (cherry picked from commit 4fc0482) Signed-off-by: Felix Cheung <felixcheung@apache.org>
### What is this PR for? This is one of the flaky tests that fails with "should have a welcome message" because Z-Server did not start by the time test started executing. ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * [ZEPPELIN-3306](https://issues.apache.org/jira/browse/ZEPPELIN-3306) ### How should this be tested? * CI should pass ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes apache#2853 from prabhjyotsingh/ZEPPELIN-3306 and squashes the following commits: 38a4297 [Prabhjyot Singh] upgrade chrome=2.35 f82a00a [Prabhjyot Singh] set spawn as false for both zeppelin-web and zeppelin-integration 8742b11 [Prabhjyot Singh] ZEPPELIN-3306: Web e2e test fails (cherry picked from commit f4a798b) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com> # Conflicts: # .travis.yml
What is this PR for? During Import/Clone Paragraph set "user" to eliminate NPEs thrown in Helium and other functions leaving unusable notebooks. What type of PR is it? [Bug Fix] Todos What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3309 How should this be tested? Manually tested using Import/Clone of Notebooks and attempt to adjust bound interpreters Screenshots (if appropriate) Questions: Does the licenses files need update? No Is there breaking changes for older versions? No Does this needs documentation? No Author: Greg Senia gseniaapache.org Author: gss2002 <greg@senia.org> Closes apache#2855 from gss2002/ZEPPELIN-3309 and squashes the following commits: b8c35c9 [gss2002] ZEPPELIN-3309. Import/Clone user not set in Paragraph causes NPE. (cherry picked from commit 803116f) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? When loading interpreter.json, also update interpreterBindings as we change change interpreter setting id in ZEPPELIN-3208. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3322 ### How should this be tested? * Unit test is added. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2861 from zjffdu/ZEPPELIN-3322 and squashes the following commits: 94f4882 [Jeff Zhang] ZEPPELIN-3322. Update interpreterBind when restarting zeppelin server (cherry picked from commit 4463967) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…er - Encoding Issue ### What is this PR for? ZEPPELIN-3099 Livy Interpreter doesn't support German Special Character - Encoding Issue ### What type of PR is it? BUG FIX for : ZEPPELIN-3099 ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3099 ### How should this be tested? test with German Special Characters like ß, ü, Ü, ä, Ä, ö, Ö . Author: Akhil Subhash Naik <asnaik@hortonworks.com> Closes apache#2860 from Akhilsnaik/ZEPPELIN-3099-master and squashes the following commits: eee2f5a [Akhil Subhash Naik] ZEPPELIN-3099 Implement the UT cases and fix review comments (asnaik) ecf4b54 [Akhil Subhash Naik] ZEPPELIN-3099 Implement the UT cases and fix review comments (asnaik) 7a65776 [Akhil Subhash Naik] ZEPPELIN-3099 Livy Interpreter doesn't support German Special Character - Encoding Issue (asnaik) (cherry picked from commit b9d2f40) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? Minor fix for more proper error message when interpreter is not binded ### What type of PR is it? [Bug Fix | Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * NO jira created ### How should this be tested? * CI pass ### Screenshots (if appropriate) Before  After  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2865 from zjffdu/HOTFIX_INTP and squashes the following commits: 0a22913 [Jeff Zhang] [HOTFIX] More proper error message when interpreter is not binded (cherry picked from commit 514ba65) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? Add plotting for LivyInterpreter (Python & R) ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3328 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2866 from zjffdu/ZEPPELIN-3328 and squashes the following commits: fd394e3 [Jeff Zhang] ZEPPELIN-3328. Add plotting test for LivyInterpreter (cherry picked from commit 9ec6eb5) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
…ponent only interpreter component need to copy interpreter dependency and interpreter-setting.json [Bug Fix | Improvement ] * [ ] - Task * https://issues.apache.org/jira/browse/ZEPPELIN-3314 * CI pass * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2857 from zjffdu/ZEPPELIN-3314 and squashes the following commits: 322530f [Jeff Zhang] ZEPPELIN-3314. Only apply maven-dependency-plugin for interpreter component (cherry picked from commit 1effc63) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
… interpreter becomes unresponsive ### What is this PR for? This PR would 2 features: 1. Make timeout of sparkr backend configurable. 2. Detect R backend dead and display proper message to frontend. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2515 ### How should this be tested? * unit test is added ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2839 from zjffdu/ZEPPELIN-2515 and squashes the following commits: 62888c5 [Jeff Zhang] ZEPPELIN-2515. After 100 minutes R process quits silently and spark.r interpreter becomes unresponsive (cherry picked from commit 8b2259c) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? HotFix for code style issue of branch-0.8 ### What type of PR is it? [Hot Fix] ### Todos * [ ] - Task ### What is the Jira issue? * No jira created ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#2868 from zjffdu/HOTFIX_JavaDoc and squashes the following commits: 69f3fc9 [Jeff Zhang] [HOTFIX] Code sytle fix for branch-0.8
This PR fix the issue of SPARK-22393 in zeppelin. We can fix this by using `SparkIMain` instead of `IMain`. [Bug Fix] * [ ] - Task * https://jira.apache.org/jira/browse/ZEPPELIN-4132 * Unit test is added * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes apache#3353 from zjffdu/ZEPPELIN-4132 and squashes the following commits: c94b34a [Jeff Zhang] [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 (cherry picked from commit 1ca7039) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? Need to check user in jobGroupId because when some paragraph is running, who run paragraph cannot be found in spark application web UI. I just add to userId. ### What type of PR is it? [Improvement] ### Todos * [x] - Modify Code ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3529 ### How should this be tested? * Check jobGroupId in Spark Application Web UI of Zeppelin Spark Interpreter ### Questions: * Does the licenses files need update? * No * Is there breaking changes for older versions? * No * Does this needs documentation? * No Author: Jaehoon Jeong <jaehoon.jeong@woowahan.com> Closes apache#3006 from woowahan-jaehoon/ZEPPELIN-3529 and squashes the following commits: b1da18c [Jaehoon Jeong] [ZEPPELIN-3529] Add uName into jobGroupId for checking user (cherry picked from commit 80de4bb) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
Upon raising the concern (ZEPPELIN-3860), we were suggested to upgrade the zeppelin service from 0.7.3 to 0.8.0 version. With the current zeppelin version i.e 0.8.0 the frequency of broken pipe error has gone up.
When connecting to a database through a database connection pool, If there is no sql operation for a long time, The database connection pool will actively close this connection. The connection between the client and the database is broken.
So by increasing
```
poolableConnectionFactory.setValidationQuery("show databases");
```
Periodically call the `show databases` statement, Keep the connection to the database.
[Bug Fix]
* https://issues.apache.org/jira/browse/ZEPPELIN-3946
The user passed the actual test, Verification solves this problem.
[CI Pass](https://travis-ci.org/liuxunorg/zeppelin/builds/539529259)
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Xun Liu <liuxun@apache.org>
Closes apache#3374 from liuxunorg/ZEPPELIN-3946 and squashes the following commits:
f2877fd [Xun Liu] [ZEPPELIN-3946] Fixed zeppelin hive interpreter broken pipe issue
(cherry picked from commit e158a3e)
Signed-off-by: liuxunorg <liuxun@apache.org>
* [ZEPPELIN-4192] temporarily disable agimatec-validation download Change-Id: I100efae19a01eb2399a8b43e85ebf8a507916949 * replace agimatec-releases with ksoap2-android-releases Change-Id: I34c240a19f0bd4e3e977ac496547482c39fd5f1e # Conflicts: # zeppelin-interpreter/src/test/java/org/apache/zeppelin/dep/DependencyResolverTest.java
…th livy 0.6.0 Change SESSION_NOT_FOUND_PATTERN to match JSON response body from Livy 0.6.0. [Bug Fix] * [ ] - Task * https://issues.apache.org/jira/browse/ZEPPELIN-4150 * CI pass * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: sergeymazin <sergey.mazin@pipedrive.com> Closes apache#3396 from sergeymazin/master and squashes the following commits: f99b348 [sergeymazin] change SESSION_NOT_FOUND_PATTERN to match JSON response body (cherry picked from commit a47f8e1) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? This PR is a re-submission of the original ZEPPELIN-1070 PR. The original PR seems to be abandoned and I am currently creating custom builds of Zeppelin with the ZEPPELIN-1070 PR included so I am interested in getting the PR merged. I am submitting two PRs one for 0.8X branch and one that includes fixes for merge conflicts to the master branch. Original PR Description: > This PR enables a generic syntax for inserting credentials. A username can be inserted by $[user.entry] where "entry" is the name of the credential. A password can be inserted by $[password.entry]. > To avoid output of the password all occurences of the password-String in the Interpreter-output will be replaced by "###". This should not be a really secure feature (since the runner of the notebook knows the password anyway), but it should avoid accidential exposure of the used passwords by any sort of interpreter ### What type of PR is it? Feature ### Todos * [ ] - Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1070 ### How should this be tested? Unit tests are included in PR ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? **No** * Is there breaking changes for older versions? **Only in very unlikely circumstances. IE: code that matched {user.VALID_CREDENTIAL_ENTITY} or {password.VALID_CREDENTIAL_ENTITY}.** * Does this needs documentation? **Yes** Author: Pascal Pellmont <github@ppo2.ch> Author: jpmcmu <jpmcmu@gmail.com> Closes apache#3415 from jpmcmu/ZEPPELIN-1070-0.8 and squashes the following commits: 66e6944 [jpmcmu] Code review changes 7e56bf4 [jpmcmu] Code review changes de714c3 [Pascal Pellmont] [ZEPPELIN-1070] if credential entry is not found then leave the pattern as is 21d9556 [Pascal Pellmont] [ZEPPELIN-1070] Replaced $[...] pattern with {...} pattern e7060f5 [Pascal Pellmont] [ZEPPELIN-1070] Inject Credentials in any Interpreter-Code
### What is this PR for? Fixed closing bracket in common.cmd file, that was causing error on running zeppelin in Windows environment ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4278 ### How should this be tested? User should be able to run Zeppelin on Windows environment ### Questions: * Does the licenses files need update? * No * Is there breaking changes for older versions? * No * Does this needs documentation? * No Author: msid <mySIDis0x11@gmail.com> Closes apache#3433 from msid/ZEPPELIN-4278 and squashes the following commits: 61338e6 [msid] [ZEPPELIN-4278]: Fixed closing bracket in bin/common.cmd
### What is this PR for? This PR is a re-submission of the original ZEPPELIN-1070 PR. The original PR seems to be abandoned and I am currently creating custom builds of Zeppelin with the ZEPPELIN-1070 PR included so I am interested in getting the PR merged. I am submitting two PRs one for 0.8X branch and one that includes fixes for merge conflicts to the master branch. Original PR Description: > This PR enables a generic syntax for inserting credentials. A username can be inserted by $[user.entry] where "entry" is the name of the credential. A password can be inserted by $[password.entry]. > To avoid output of the password all occurences of the password-String in the Interpreter-output will be replaced by "###". This should not be a really secure feature (since the runner of the notebook knows the password anyway), but it should avoid accidential exposure of the used passwords by any sort of interpreter ### What type of PR is it? Feature ### Todos * [ ] - Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1070 ### How should this be tested? Unit tests are included in PR ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? **No** * Is there breaking changes for older versions? **Only in very unlikely circumstances. IE: code that matched {user.VALID_CREDENTIAL_ENTITY} or {password.VALID_CREDENTIAL_ENTITY}.** * Does this needs documentation? **Yes** Author: Pascal Pellmont <github@ppo2.ch> Author: jpmcmu <jpmcmu@gmail.com> Author: James McMullan <jpmcmu@gmail.com> Closes apache#3415 from jpmcmu/ZEPPELIN-1070-0.8 and squashes the following commits: 6f4da84 [James McMullan] Merge branch 'branch-0.8' into ZEPPELIN-1070-0.8 3271684 [jpmcmu] Quoted password before replacement to allow $ and / in passwords. 66e6944 [jpmcmu] Code review changes 7e56bf4 [jpmcmu] Code review changes de714c3 [Pascal Pellmont] [ZEPPELIN-1070] if credential entry is not found then leave the pattern as is 21d9556 [Pascal Pellmont] [ZEPPELIN-1070] Replaced $[...] pattern with {...} pattern e7060f5 [Pascal Pellmont] [ZEPPELIN-1070] Inject Credentials in any Interpreter-Code
…ly 0.0.0.0) This PR changes default Zeppelin server binding address from `0.0.0.0` to `127.0.0.1`. Also update related configuration templates and document. mprovement https://issues.apache.org/jira/browse/ZEPPELIN-4166 Build and run Zeppelin server with default configuration and see if default port is listening in address 127.0.0.1 instead of 0.0.0.0 (netstat -na | grep 8080) * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Lee moon soo <moon@apache.org> Closes apache#3450 from Leemoonsoo/ZEPPELIN-4166 and squashes the following commits: 54dd812 [Lee moon soo] update upgrade to guide default bind address change 41741d2 [Lee moon soo] update doc 34e2ca8 [Lee moon soo] update configuration templates 18aeb8b [Lee moon soo] bind 127.0.0.1 instead of 0.0.0.0 by default (cherry picked from commit 7d7628e) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for?
Fix of : ZEPPELIN-4335 Deleting a Notebook is vulnerable to XSS attach
Issue reproduction steps :
1) create a notebook
2) give the permission to notebook as : <script>alert('hi')</script> (press space after writing this, not enter key)
3) after this, try to delete the notebook, the BootstrapDialog that popups stating insufficient privilages is vulnerable to XSS attack
### What type of PR is it?
BUG FIX ZEPPELIN-4335
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-4335
### How should this be tested?
Test as per reproduction steps :
1) create a notebook
2) give the permission to notebook as : <script>alert('hi')</script> (press space after writing this, not enter key)
3) after this, try to delete the notebook, the BootstrapDialog that popups stating insufficient privilages is vulnerable to XSS attack
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Akhil Subhash Naik <asnaik@hortonworks.com>
Closes apache#3452 from Akhilsnaik/ZEPPELIN-4335 and squashes the following commits:
95212d8 [Akhil Subhash Naik] ZEPPELIN-4335 Deleting a Notebook is vulnerable to XSS attach (asnaik)
(cherry picked from commit f9e2ff8)
Signed-off-by: Lee moon soo <moon@apache.org>
(cherry picked from commit f3f4c90)
### What is this PR for? This PR fixes docker image build error using /script/docker/zeppelin/bin/Dockerfile ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4338 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes apache#3455 from Leemoonsoo/ZEPPELIN-4338 and squashes the following commits: 953102f [Lee moon soo] Add allow-unauthenticated (cherry picked from commit 7b93561) Signed-off-by: Lee moon soo <moon@apache.org>
(cherry picked from commit 455bfc4)
…ter search ### What is this PR for? In chrome browser, After login with saved-autocomplete feature in chrome and input username in note filter then refresh, note filter is filled username automatically. It also happen in interpreter page. this happening with just chrome. in past, it is not happening this in chrome. I think that disable auto-complete feature in note filter is better. ### What type of PR is it? [Improvement] ### Todos * [x] - modify ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4299 ### How should this be tested? * Login with autocomplete feature in chrome * input username in note filter * refresh * refresh In interpreter page ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? * No * Is there breaking changes for older versions? * No * Does this needs documentation? * No Author: Jaehoon Jeong <jaehoon.jeong@woowahan.com> Closes apache#3423 from woowahan-jaehoon/ZEPPELIN-4299 and squashes the following commits: 536ea79 [Jaehoon Jeong] [ZEPPELIN-4299] disable autocomplete in note search and interpreter search (cherry picked from commit c778a9d)
…ing the visualizations ### What is this PR for? Fix an issue that makes an infinite loop while switching the visualizations. An infinite loop occurs because the front-end web application tries to commit the paragraph even if there are no changes in the visualization configuration. ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4280 ### How should this be tested? If you switch quickly between different visualizations multiple times, the infinite loops should not happen. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jaewon Seo <jaewon@zepl.com> Closes apache#3414 from Byeol/ZEPPELIN-4280 and squashes the following commits: d49d36a [Jaewon Seo] Commit the paragraph only if there are changes in the visualization configuration (cherry picked from commit be7ace1) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? This is followup issue for ZEPPELIN-4280, to add some comments on the code. ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4280 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes apache#3461 from Leemoonsoo/ZEPPELIN-4280-followup and squashes the following commits: 75d4995 [Lee moon soo] add comment (cherry picked from commit 7d74b92) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? We can create new interpreters based on existing ones, but we don't enforce its name, so it's possible to enter it with space and other characters, that aren't handled correctly by Bash. This PR fixes this problem. ### What type of PR is it? Bug Fix ### What is the Jira issue? * ZEPPELIN-4377 ### How should this be tested? * Tested manually Author: Alex Ott <alexott@gmail.com> Author: Jeff Zhang <zjffdu@apache.org> Author: Alex Ott <alexey.ott@datastax.com> Closes apache#3482 from alexott/ZEPPELIN-4377-0.8 and squashes the following commits: ac884c1 [Alex Ott] [ZEPPELIN-4377] Add UI validation for interpreter name 0cc4afc [Alex Ott] [ZEPPELIN-4377] Interpreter doesn't start if name has space f7a77e4 [Alex Ott] Merge branch 'branch-0.8' of git://github.com/apache/zeppelin into branch-0.8 fecd6ea [Alex Ott] Merge branch 'branch-0.8' of git://github.com/apache/zeppelin into branch-0.8 74e29d1 [Alex Ott] Merge branch 'branch-0.8' of github.com:apache/zeppelin into branch-0.8 7cbaa4a [Alex Ott] Merge branch 'branch-0.8' of github.com:apache/zeppelin into branch-0.8 3040700 [Jeff Zhang] Preparing development version 0.8.1-SNAPSHOT 7f4f8e5 [Jeff Zhang] Preparing Apache Zeppelin release 0.8.0
…user ### What is this PR for? this PR add an improvement to zeppelin docker image by running zeppelin server under non-root user ### What type of PR is it? Improvement ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4368 ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: abdelouahab EL OUAZZANY <a.elouazzany@gmail.com> Closes apache#3484 from elouazzany/ZEPPELIN-4368 and squashes the following commits: 9f0fbaa [abdelouahab EL OUAZZANY] [ZEPPELIN-4368][Docker image] for security reason the zeppelin server should run under Non-root user
### What is this PR for? Allow getting of roles to work when more than 1 realm. ### What type of PR is it? Bug Fix ### Todos * [ ] - add test? This is hard due to multiple realms ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4341 ### How should this be tested? Hard to test. I will look at your CI next week. I tested in my local environment * todo. check out https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * i did not see any tests related to this code. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Tony Primerano <primerano@tonycode.com> Closes apache#3466 from primerano/ZEPPELIN-4341 and squashes the following commits: 8fc870e [Tony Primerano] [ZEPPELIN-4341] swap printStackTrace for log.warn 5ba656e [Tony Primerano] [ZEPPELIN-4341] change log.debug to log.warn when problem fetching roles. 751c699 [Tony Primerano] [ZEPPELIN-4341] - update getRoles to handle any upstream exception 9a37926 [Tony Primerano] [ZEPPELIN-4341] fix break placement ad26443 [Tony Primerano] [ZEPPELIN-4341] update SecurityUtils#getRoles to catch errors so if multiple realms they will all be attempted
### What is this PR for? Updating 'Credentials' causes the following error and will not be fixed. <img width="958" alt="Screen Shot 2019-11-14 at 10 13 21 PM" src="https://user-images.githubusercontent.com/42430609/68860902-c055e980-072d-11ea-9e09-81bf60fb6d06.png"> ### What type of PR is it? [Bug Fix] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4449 ### How should this be tested? * First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * Strongly recommended: add automated unit tests for any new or changed behavior * Outline any manual steps to test the PR here. ### Screenshots (if appropriate) before  after  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: LeeDongMyeong <dev.dmlee@gmail.com> Closes apache#3521 from eldiem/fix-credentials and squashes the following commits: 85f084f [LeeDongMyeong] Add validation 5ebae90 [LeeDongMyeong] [ZEPPELIN-4449] Fix Credentials update errors (cherry picked from commit 4d9a2d0) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What is this PR for?
Fix the stability problem of zengin for long time (7day) loop working ,
release the thread pools and socket connection when the interprether is closed
the same bug was found in the version 0.81 and 0.82
What type of PR is it?
[Bug Fix ]
Todos
What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-4600
How should this be tested?
Screenshots (if appropriate)
Questions: