Branch 0.7#2376
Closed
simulight wants to merge 234 commits into
Closed
Conversation
…e JDBC queries ### What is this PR for? Use multiple InterpreterResult for displaying multiple JDBC queries. IMO since other sql editors allows to execute multiple sql separated with ";" and ours display mechanism being more powerful, hence, it should also allow the same. ### What type of PR is it? [Improvement] ### What is the Jira issue? * [ZEPPELIN-1906](https://issues.apache.org/jira/browse/ZEPPELIN-1906) ### How should this be tested? Try running following in a paragraph (with Postgres setting) and check for output. ``` %jdbc create table test_temp_table (id int); select column_name, data_type, character_maximum_length from INFORMATION_SCHEMA.COLUMNS where table_name = 'test_temp_table'; SELECT table_name FROM information_schema.tables WHERE table_schema = 'public'; drop table test_temp_table; SELECT table_name FROM information_schema.tables WHERE table_schema = 'public'; ``` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #1845 from prabhjyotsingh/ZEPPELIN-1906 and squashes the following commits: b27352a [Prabhjyot Singh] on error show previous output. f9fd5c6 [Prabhjyot Singh] allow last query to be without ";" b3e742e [Prabhjyot Singh] fixing checkstyle-fail-build ac4663d [Prabhjyot Singh] add block comment f3da37f [Prabhjyot Singh] replace regex with slightly better logic. e6727b5 [Prabhjyot Singh] add testcase for spliting sql. c096e76 [Prabhjyot Singh] remove extra empty lines e675190 [Prabhjyot Singh] user same connection instead of creating new everytime f5ab796 [Prabhjyot Singh] Use multiple InterpreterResult for displaying multiple JDBC queries (cherry picked from commit 8464971) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
### What is this PR for? This PR will add an example of batch processing with Flink to Zeppelin tutorial notebooks. There are no any Flink notebooks in the tutorial at the moment. ### What type of PR is it? Improvement ### What is the Jira issue? [ZEPPELIN-1787](https://issues.apache.org/jira/browse/ZEPPELIN-1787) ### How should this be tested? You should open `Using Flink for batch processing` notebook from the `Zeppelin Tutorial` folder and run all paragraphs one by one ### Questions: * Does the licenses files need update? - **no** * Is there breaking changes for older versions? - **no** * Does this needs documentation? - **no** Author: Alexander Shoshin <Alexander_Shoshin@epam.com> Closes #1758 from AlexanderShoshin/ZEPPELIN-1787 and squashes the following commits: 83cbffb [Alexander Shoshin] remove localhost url 5255e17 [Alexander Shoshin] Merge branch 'master' into ZEPPELIN-1787 0b9df56 [Alexander Shoshin] add a link for this notebook to Zeppelin documentation 593c47d [Alexander Shoshin] convert notebook to 0.7.0 format 9013620 [Alexander Shoshin] convert notebook to 0.6.2 format fe2a39e [Alexander Shoshin] add download instruction, change "wget" to "curl" f64b60a [Alexander Shoshin] [ZEPPELIN-1787] Add an example of Flink Notebook (cherry picked from commit 0da08d1) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
… note ### What is this PR for? * Minor update for pig interpreter * Add one sample pig tutorial note which do the same thing as the spark tutorial note. ### What type of PR is it? [Improvement | Documentation ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1867 ### How should this be tested? Tested manually ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1830 from zjffdu/ZEPPELIN-1867 and squashes the following commits: 1c0d819 [Jeff Zhang] rename note name 50198a1 [Jeff Zhang] add more description of tutorial note 88385f2 [Jeff Zhang] Add pig tutorial note 25216f8 [Jeff Zhang] ZEPPELIN-1867. Update document for pig interpreter and add one sample note (cherry picked from commit 3d2d4b6) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
### What is this PR for? This PR is for improvement to show folder and note after using the filter. And I found some bugs and fixed like this. the following list is improvement and bug fixed. 1. After using the filter in Zeppelin Home, every note is shown by the form [FolderName/NoteName] like below. It would be nice to show folder icon and note icon as previous status.  2. When using the filter, some functions and icons next to note and folder are disappeared.  3. When using the filter, the `Rename Note` function doesn't work. ( When I was handling this PR, this bug was discovered.)  ### What type of PR is it? [ Bug Fix | Improvement ] ### Todos * [x] - improve to show folder and note when finishing to use filter. * [x] - some functions and icons next to note and folder are appeared when using filter. * [x] - fix `Rename Note` function when using the filter. ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1864 ### How should this be tested? - **[Test 1]** Before/After using the filter, check the list structure of your notes. It must be same appearance. - **[Test 2]** When using the filter, check the notes. Some icons and functions next to note and folder must be appeared. - **[Test 3]** When using the filter, click `Rename Note`. It must be appeared the path of Note. ### Screenshots (if appropriate) **Test 1**.  **Test 2**.  **Test 3**.  ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: soralee <sora0728@nflabs.com> Closes #1834 from soralee/ZEPPELIN-1864 and squashes the following commits: 6fb53aa [soralee] resolve conflict fd2c243 [soralee] resolve conflict 3e4b8ae [soralee] fix for that filter of navbar and home don't work 61680e5 [soralee] Improvement to show folder and note after searching note 69d6d6d [soralee] Improvement to show folder and note after searching note (cherry picked from commit d393a5b) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
### What is this PR for? Remove unused imports; Replace "Thread.sleep" (unstable solution); Add "deleteTestNotebook()" method -> testWidth. ### What type of PR is it? [Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] ### How should this be tested? Travis-CI ### Screenshots (if appropriate) https://travis-ci.org/apache/zeppelin/builds/190644901 -> https://travis-ci.org/apache/zeppelin/jobs/190644918 ### Questions: * Does the licenses files need update? (no) * Is there breaking changes for older versions? (no) * Does this needs documentation? (no) Author: Unknown <Sokurito@gmail.com> Closes #1882 from bitchelov/automationTestFix and squashes the following commits: f898c59 [Unknown] [MINOR] Small Selenium test fixes (cherry picked from commit 4342156) Signed-off-by: Jongyoul Lee <jongyoul@apache.org>
…tion ### What is this PR for? This is to add spark impersonation using --proxy-user option. note that it enables also to use spark impersonation without having logged user as system user with configured ssh. ### What type of PR is it? Improvement ### Todos * [x] - add `--proxy-user` * [x] - try on standalone spark 1.6.2 * [x] - try on yarn-client mode spark 2.0.1 ### What is the Jira issue? Directly solves [ZEPPELIN-1730](https://issues.apache.org/jira/browse/ZEPPELIN-1730) and also solves [ZEPPELIN-1587](https://issues.apache.org/jira/browse/ZEPPELIN-1587) according to discussion in #1566 since using `--proxy-user` in `spark-submit` is preferable method. ### How should this be tested? 1. switch your spark cluster to `per user` and `isolated` mode 2. set up `user impersonation` flag 3. run some job using that spark interpreter 4. spark context should be created with currently logged in user credentials on behalf of system user ### Screenshots (if appropriate) standalone  yarn-client <img width="997" alt="screen shot 2017-01-04 at 10 00 13 am" src="https://cloud.githubusercontent.com/assets/1642088/21653117/75410fde-d264-11e6-886f-11d8b5dbd29e.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #1840 from khalidhuseynov/feat/spark-proxy-user and squashes the following commits: e4251de [Khalid Huseynov] update doc with env var dc61cae [Khalid Huseynov] check for env spark_proxy in interpreter.sh 8b66740 [Khalid Huseynov] add spark_proxy_user to env.sh 892b7e4 [Khalid Huseynov] add note in docs 4c3dba9 [Khalid Huseynov] add --proxy-user option for spark (cherry picked from commit 5e0aacf) Signed-off-by: Jongyoul Lee <jongyoul@apache.org>
### What is this PR for? After #1830 merged, Pig tutorial note placed as a first under `Zeppelin Tutorial` folder. I told to zjffdu, I thought the note name should be same with Spark ("Basic Feature (Spark)") in [this comment](#1830 (comment)) (because they have same contents). <img src="https://cloud.githubusercontent.com/assets/10060731/21879248/a6d9b88a-d8da-11e6-8f43-5ef192e5895c.png" width="300px"> But considering the number of Spark and Pig users, the Spark tutorial note needs to be placed as first I think. <img src="https://cloud.githubusercontent.com/assets/10060731/21879244/a488e3d0-d8da-11e6-9e0b-c91ca890c611.png" width="300px"> ### What type of PR is it? Rename Pig tutorial note ### What is the Jira issue? N/A ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1889 from AhyoungRyu/rename/pigTutorialNote and squashes the following commits: f08fd69 [AhyoungRyu] Rename Pig tutorial note to consider priority (cherry picked from commit b9c667a) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
### What is this PR for? This PR avoids browser cache. ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1229 ### How should this be tested? 1. Run old version of zeppelin(I was using 0.6.1) and show main page up in your browser. 2. Stop zeppelin. 3. Run this PR of Zeppelin and show page up on the same browser of 1. 4. check main page changed. - before (Job menu doesn't show)  - after (Job menu show)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <hsshim@zepl.com> Closes #1858 from astroshim/ZEPPELIN-1229 and squashes the following commits: 18defbe [astroshim] modify regx 85e0a05 [astroshim] remove arguments in code ca09eac [astroshim] change path 13d8056 [astroshim] trying another way 6b554e0 [astroshim] Merge branch 'master' into ZEPPELIN-1229 655dc3d [astroshim] tag all html c94de90 [astroshim] delete unnecessary codes 9d9f76f [astroshim] fix ZEPPELIN-1229 (cherry picked from commit 02323e2) Signed-off-by: Mina Lee <minalee@apache.org>
### What is this PR for? This is to fix bug of creating interpreter with impersonation enabled ### What type of PR is it? Bug Fix ### Todos * [x] - fix model ### What is the Jira issue? [ZEPPELIN-1936](https://issues.apache.org/jira/browse/ZEPPELIN-1936) ### How should this be tested? create new interpreter with "User Impersonation" enabled ### Screenshots (if appropriate) before:  after:  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #1884 from khalidhuseynov/fix/new-interp-impersonation-setting and squashes the following commits: d5f8393 [Khalid Huseynov] fix model on interpreter-create (cherry picked from commit 7290200) Signed-off-by: Mina Lee <minalee@apache.org>
### What is this PR for? When one or more hidden editors are present, clicking on the editor will cause a blur error. This means that when a paragraph is hidden through ng-if, Caused by calling the blur method in the absence of an editor object. ### What type of PR is it? Hot Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1932 ### How should this be tested? 1. create paragraph and open debug console. 2. enable hide paragraph. 3. page refresh 4. click to anywhere paragraph. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: cloverhearts <cloverheartsdev@gmail.com> Closes #1879 from cloverhearts/hotfix/paragraphOnfocusEvent and squashes the following commits: 7071638 [cloverhearts] fix show title and paragraph context issue 8f4d0bf [cloverhearts] fixed readonly event error 5ecfabb [cloverhearts] check editor object is undeifned. (cherry picked from commit 2b0e2a4) Signed-off-by: Mina Lee <minalee@apache.org>
### What is this PR for? Add missing commands to the `python.conda` interpreter - `conda info` - `conda list` - `conda create` - `conda install` - `conda uninstall (alias of remove)` - `conda env *` #### Implementation Detail The reason I modified `PythonProcess` is due to NPE ```java // https://github.com/apache/zeppelin/blob/master/python/src/main/java/org/apache/zeppelin/python/PythonProcess.java#L107-L118 public String sendAndGetResult(String cmd) throws IOException { writer.println(cmd); writer.println(); writer.println("\"" + STATEMENT_END + "\""); StringBuilder output = new StringBuilder(); String line = null; // NPE when line is null while (!(line = reader.readLine()).contains(STATEMENT_END)) { logger.debug("Read line from python shell : " + line); output.append(line + "\n"); } return output.toString(); } ``` ``` java.lang.NullPointerException at org.apache.zeppelin.python.PythonProcess.sendAndGetResult(PythonProcess.java:113) at org.apache.zeppelin.python.PythonInterpreter.sendCommandToPython(PythonInterpreter.java:250) at org.apache.zeppelin.python.PythonInterpreter.bootStrapInterpreter(PythonInterpreter.java:272) at org.apache.zeppelin.python.PythonInterpreter.open(PythonInterpreter.java:100) at org.apache.zeppelin.python.PythonCondaInterpreter.restartPythonProcess(PythonCondaInterpreter.java:139) at org.apache.zeppelin.python.PythonCondaInterpreter.interpret(PythonCondaInterpreter.java:88) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:494) at org.apache.zeppelin.scheduler.Job.run(Job.java:175) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ``` ### What type of PR is it? [Improvement | Refactoring] ### Todos * [x] - info * [x] - list * [x] - create * [x] - install * [x] - uninstall (= remove) * [x] - env * ### What is the Jira issue? [ZEPPELIN-1917](https://issues.apache.org/jira/browse/ZEPPELIN-1917) ### How should this be tested? 1. Install [miniconda](http://conda.pydata.org/miniconda.html) 2. Make sure that your python interpreter can use `conda` (check the Interpreter Binding page) 3. Remove `test` conda env since we will create in the following section ```sh $ conda env remove --yes --name test ``` 4. Run these commands with `%python.conda` ``` %python.conda info %python.conda env list %python.conda create --name test # you should be able to see `test` in the list %python.conda env list %python.conda activate pymysql %python.conda install pymysql # you should be able to import %python import pymysql.cursors %python.conda uninstall pymysql %python.conda deactivate pymysql # you should be able to see `No module named pymysql.cursor` since we deactivated %python import pymysql.cursors ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO Author: 1ambda <1amb4a@gmail.com> Closes #1868 from 1ambda/ZEPPELIN-1917/improve-conda-interpreter and squashes the following commits: 3ba171a [1ambda] fix: Wrap output style 292ed6d [1ambda] refactor: Throw exception in runCommand 2d4aa7d [1ambda] test: Add some tests 49a4a11 [1ambda] feat: Supports other env commands 6eb7e92 [1ambda] fix: NPE in PythonProcess 9c5dd86 [1ambda] refactor: Activate, Deactivate f955889 [1ambda] fix: minor 935cb89 [1ambda] refactor: Abstract commands b1c4c9f [1ambda] feat: Add conda remove (uninstall) e539c42 [1ambda] feat: Add conda install 4f58fa2 [1ambda] feat: Add conda create 7da132d [1ambda] docs: Add missing conda list description 929ca8a [1ambda] feat: Make conda output beautiful 0c6ebb4 [1ambda] feat: Add list conda command 017c76f [1ambda] refactor: Import InterpreterResult.{Code, Type} to short codes b8a5154 [1ambda] refactor: Simplify exception flow so private funcs don't need care exceptions 64d4bef [1ambda] style: Rename some funcs afc456d [1ambda] refactor: Add private to member vars f36fc74 [1ambda] feat: Add info command 2eb9bf5 [1ambda] style: Remove useless newlines bd2564e [1ambda] refactor: PythonCondaInterpreter.interpret f0d69bc [1ambda] fix: Use specific command for env list in conda (cherry picked from commit 034fdc6) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? using Object.hashCode() as part of the REPL wrapper class name can cause a compilation error as hashCode can validly return a negative integer. We would like this fix backported to 0.6 and later streams. ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1560 ### How should this be tested? regression tests with openJdk + tests with IBM jvm ### Screenshots (if appropriate) N/A ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: robbins <robbins@uk.ibm.com> Closes #1894 from robbinspg/ZPPELIN-1560 and squashes the following commits: eeef3ad [robbins] [ZEPPELIN-1560] avoid generating minus sign in package name (cherry picked from commit 068c894) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? Does not working settings menu in zeppelin web graph ui ### What type of PR is it? Bug Fix ### How should this be tested? 1. toggle settings menu in zeppelin graph ui ### Screenshots (if appropriate) #### Before  #### After  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: cloverhearts <cloverheartsdev@gmail.com> Closes #1899 from cloverhearts/ZEEPELIN-SETTING-PROBLEM-WEB-UI and squashes the following commits: e3453b7 [cloverhearts] invalid render life cycle for setting (cherry picked from commit 59e15c0) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? Fixed importing packages in pyspack requested by `SPARK_SUBMIT_OPTION` ### What type of PR is it? [Bug Fix] ### Todos Nothing ### What is the Jira issue? [ZEPPELIN-1883](https://issues.apache.org/jira/browse/ZEPPELIN-1883) ### How should this be tested? 0. Download Apache Spark 1.6.2 (since it's the most recent for pyspark-cassandra) 1. Set `SPARK_HOME` and `SPARK_SUBMIT_OPTION` in `conf/zeppelin-env.sh` like ```sh export SPARK_HOME="~/github/apache-spark/1.6.2-bin-hadoop2.6" export SPARK_SUBMIT_OPTIONS="--packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api" ``` 2. Check before that you can run `spark-submit` or not ``` ./bin/spark-submit --packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api --class org.apache.spark.examples.SparkPi lib/spark-examples-1.6.2-hadoop2.6.0.jar ``` 3. Test whether submitted packages can be import or not ``` %pyspark import pyspark_cassandra ``` ### Screenshots (if appropriate) ``` import pyspark_cassandra Traceback (most recent call last): File "/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py", line 267, in <module> raise Exception(traceback.format_exc()) Exception: Traceback (most recent call last): File "/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py", line 265, in <module> exec(code) File "<stdin>", line 1, in <module> ImportError: No module named pyspark_cassandra ``` ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO Author: 1ambda <1amb4a@gmail.com> Closes #1831 from 1ambda/ZEPPELIN-1883/cant-import-submitted-packages-in-pyspark and squashes the following commits: 585d48a [1ambda] Use spark.jars instead of classpath f76d2c8 [1ambda] fix: Do not extend PYTHONPATH in yarn-client c735bd5 [1ambda] fix: Import spark submit packages in pyspark (cherry picked from commit cb8e418) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for?
Change method name (Method names should comply with a naming convention). Remove unused imports. Using append makes code simpler to read `sb.append("\nAccessTime = ").append(accessTime);` instead `sb.append("\nAccessTime = " + accessTime);`
### What type of PR is it?
[Refactoring]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1839
### How should this be tested?
HDFSFileInterpreterTest.java (still working)
### Questions:
* Does the licenses files need update? (no)
* Is there breaking changes for older versions? (no)
* Does this needs documentation? (no)
Remove this unused import, naming convention
Author: Unknown <Sokurito@gmail.com>
Closes #1747 from bitchelov/hdfsFileInterpreterSmallChanges and squashes the following commits:
6d27bb8 [Unknown] Minor changes
(cherry picked from commit 69bc353)
Signed-off-by: Jongyoul Lee <jongyoul@apache.org>
…new session ### What is this PR for? By default, livy session will expire after one hour. This PR would create session automatically for user if session is expired, and would also display the session expire information in frontend. The expire message would only display at the first time of session recreation, after that the message won't be displayed. ### What type of PR is it? [Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1293 ### How should this be tested? Tested manually.  ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1861 from zjffdu/ZEPPELIN-1293 and squashes the following commits: e174593 [Jeff Zhang] minor update on warning message 30c3569 [Jeff Zhang] address comments 88f0d9a [Jeff Zhang] ZEPPELIN-1293. Livy Interpreter: Automatically attach or create to a new session
### What is this PR for?
Current helium plugin application api (experimental) requires create library in java class, and need to create both backend / frontend code in the package. Which is good if your plugin requires both frontend and backend code running.
However, when user just want to make new visualization which completely runs on front-end side in javascript, creating helium application in java project and taking care of backend code can be bit of overhead and barrier for javascript developers.
This PR adds capability to load pure javascript package as a visualization.
### how it works
1. create (copy, download) 'helium package json' file into `ZEPPELIN_HOME/helium` directory.
The json file point visualization js package in npm repository or local file system in `artifact` field.
`type` field in the json file need to be `VISUALIZATION`
Here's an example (zeppelin-examples/zeppelin-example-horizontalbar/zeppelin-example-horizontalbar.json)
```
{
"type" : "VISUALIZATION",
"name" : "zeppelin_horizontalbar",
"description" : "Horizontal Bar chart (example)",
"artifact" : "./zeppelin-examples/zeppelin-example-horizontalbar",
"icon" : "<i class='fa fa-bar-chart rotate90flipX'></i>"
}
```
2. Go to helium GUI menu. (e.g. http://localhost:8080/#/helium).
The menu will list all available packages.
<img width="796" alt="writing_visualization_helium_menu" src="https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png">
3. click 'enable' in any package want to use.
Once a visualization package is enabled, `HeliumVisualizationFactory` will collect all enabled visualizations and create js bundle on the fly.
4. js bundle will be loaded on notebook and additional visualization becomes available
### Programming API to create new plugin visualization.
Simply extends [visualization.js](https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/visualization/visualization.js) and overrides some methods, such as
```
/**
* get transformation
*/
getTransformation() {
// override this
};
/**
* Method will be invoked when data or configuration changed
*/
render(tableData) {
// override this
};
/**
* Refresh visualization.
*/
refresh() {
// override this
};
/**
* method will be invoked when visualization need to be destroyed.
* Don't need to destroy this.targetEl.
*/
destroy() {
// override this
};
/**
* return {
* template : angular template string or url (url should end with .html),
* scope : an object to bind to template scope
* }
*/
getSetting() {
// override this
};
```
This is exactly the same api that built-in visualization uses.
an example implementation included `zeppelin-examples/zeppelin-example-horizontalbar/horizontalbar.js`.
Actually [all built-in visualizations](https://github.com/apache/zeppelin/tree/master/zeppelin-web/src/app/visualization/builtins) are example
### Packaging and publishing visualization
Each visualization will need `package.json` file (e.g. `zeppelin-examples/zeppelin-example-horizontalbar/package.json`) to be packaged.
Package can be published in npm repository or package can be deployed to the local filesystem.
`zeppelin-examples/zeppelin-example-horizontalbar/` is an example package that is deployed in the local filesystem
### Development mode
First, locally install and enable your development package by setting `artifact` field to the development directory.
Then run zeppelin-web in visualization development mode with following command
```
cd zeppelin-web
npm run visdev
```
When you have change in your local development package, just reload your notebook. Then Zeppelin will automatically rebuild / reload the package.
Any feedback would be appreciated!
### What type of PR is it?
Feature
### Todos
* [x] - Load plugin visualization js package on runtime
* [x] - Make the feature works in zeppelin Binary package
* [x] - Show loading indicator while 'enable' / 'disable' package
* [x] - Add document
* [x] - Add license of new dependency
* [x] - Development mode
* [x] - Propagate error to front-end
* [x] - Display multiple versions of a package.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1619
### How should this be tested?
Build Zeppelin with `-Pexamples` flag. That'll install example visualization package `horizontalbar`.
You'll able to select `horizontalbar` along with other built-in visualizations
To test npm online package install capability, Place [zeppelin-bubble.json](https://github.com/Leemoonsoo/zeppelin-bubble/blob/master/zeppelin-bubble.json) in hour local registry (`ZEPPELIN_HOME/helium`) and enable it in Helium gui menu.
And then zeppelin will download package from npm repository and load.
### Questions:
* Does the licenses files need update? yes
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Lee moon soo <moon@apache.org>
Closes #1842 from Leemoonsoo/ZEPPELIN-1619-rebased and squashes the following commits:
7c49bbb [Lee moon soo] Let Zeppelin continue to bootstrap on offline
816bdec [Lee moon soo] Display license of package when enabling
28fb37d [Lee moon soo] beautifulize helium menu
295768e [Lee moon soo] fix drag and drop visualization reorder
bb304db [Lee moon soo] Sort version in decreasing order
e7f18f1 [Lee moon soo] fix english in docs and labels
c7b187f [Lee moon soo] Merge branch 'master' into ZEPPELIN-1619-rebased
4c87983 [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased
ecd925b [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased
a92cadd [Lee moon soo] Use minifiable syntax
cec534c [Lee moon soo] Reduce log message
f373f1d [Lee moon soo] Ignore removed package
e18d9a4 [Lee moon soo] Ability to customize order of visualization package display
cd74396 [Lee moon soo] Add rest api doc
9de5d6d [Lee moon soo] exclude .npmignore and package.json from zeppelin-web rat check
08abded [Lee moon soo] exclude package.json from rat check
661c26b [Lee moon soo] update screenshot and keep experimental tag only in docs
4515805 [Lee moon soo] Display multiple versions of a package
408c512 [Lee moon soo] Make unittest test bundling with proper vis package on npm registry
fb7a147 [Lee moon soo] display svg icon
47de6d9 [Lee moon soo] Propagate bundle error to the front-end
0fe5e00 [Lee moon soo] visualization development mode
022e8f6 [Lee moon soo] exclude zeppelin-examples/zeppelin-example-horizontalbar/package.json file from rat check
2ef3b69 [Lee moon soo] Add new dependency license
f943d33 [Lee moon soo] Add doc
f494dbd [Lee moon soo] package npm dependency module in binary package
b655fa6 [Lee moon soo] use any version of dependency in example. so zeppelin version bumpup doesn't need to take care of them
2aec52d [Lee moon soo] show loading indicator while enable/disable package
6c380f6 [Lee moon soo] refactor code to fix HeliumTest
e142336 [Lee moon soo] update unittest
7d5e0ae [Lee moon soo] Resolve dependency conflict
c50a524 [Lee moon soo] Add conf/helium.json in .gitignore
1c7b73a [Lee moon soo] add result.css
d2823ad [Lee moon soo] load visualization and tabledata module from source instead npm if accessible
4e1b061 [Lee moon soo] Convert horizontalbar to VISUALIZATION example
a5a935b [Lee moon soo] connect visualization factory with restapi
4b21252 [Lee moon soo] initial implementation of helium menu
0c4da2e [Lee moon soo] pass bundled visualization to result.controller.js
f5ce99e [Lee moon soo] import helium service js
1663582 [Lee moon soo] initial implementation of helium menu
74d52d4 [Lee moon soo] bundle visualization package from npm repository on the fly
(cherry picked from commit 300f753)
Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? Two screenshot imgs in [Writing a new visualization](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html) page are broken after deployed. It can be fixed by using relative path like other images. (e.g. [shiroauthentication.md](https://github.com/apache/zeppelin/blob/master/docs/security/shiroauthentication.md#4-login)) ### What type of PR is it? Hot Fix ### What is the Jira issue? [ZEPPELIN-1970](https://issues.apache.org/jira/browse/ZEPPELIN-1970) ### How should this be tested? It can't be reproduced using docs dev mode. Needs to be tested with below steps. ``` 1) build gh-pages (website) branch JEKYLL_ENV=production bundle exec jekyll build cp -r _site/ /tmp/zeppelin_website/ mkdir -p /tmp/zeppelin_website/docs/0.7.0-SNAPSHOT 2) build this patch (docs) and copy it under docs/0.7.0-SNAPSHOT of website cd docs bundle exec jekyll build --safe cp -r _site/ /tmp/zeppelin_website/0.7.0-SNAPSHOT/ 3) start httpserver and browse http://localhost:8000/docs/0.7.0-SNAPSHOT/ cd /tmp/zeppelin_website python -m SimpleHTTPServer ``` ### Screenshots (if appropriate) - before <img width="809" alt="screen shot 2017-01-15 at 3 10 53 pm" src="https://cloud.githubusercontent.com/assets/10060731/21960655/a73ee658-db35-11e6-8e4d-7702adb1ab19.png"> - after <img width="751" alt="screen shot 2017-01-15 at 3 10 13 pm" src="https://cloud.githubusercontent.com/assets/10060731/21960650/a23348a2-db35-11e6-80a4-a6bc9b9b188c.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1901 from AhyoungRyu/ZEPPELIN-1970 and squashes the following commits: d64e13f [AhyoungRyu] Use relative path for screenshot imgs (cherry picked from commit f86bb85) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
…interpreter setting ### What is this PR for? Two improvements for pig interpreter. * Set job name via paragraph title if it exists, otherwise use the last line of pig script * Allow to set any pig property in interpreter setting ### What type of PR is it? [ Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1933 ### How should this be tested? Unit tested and manually tested. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1885 from zjffdu/ZEPPELIN-1933 and squashes the following commits: d2e1cd4 [Jeff Zhang] address comments 9cee380 [Jeff Zhang] ZEPPELIN-1933. Set pig job name and allow to set pig property in pig interpreter setting (cherry picked from commit 41f9fd9) Signed-off-by: Felix Cheung <felixcheung@apache.org>
### What is this PR for? * Change hadoop profile from `hadoop-2.4` to `hadoop-2.6` * Use `SCALA_VERSION` variable instead of hardcoding * Specify projects to be built for netinst package instead of excluding unnecessary projects. ### What type of PR is it? Build ### What is the Jira issue? ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Mina Lee <minalee@apache.org> Closes #1890 from minahlee/update/release_script and squashes the following commits: a97b5fe [Mina Lee] Remove one r interpreter profile as only one will take effect 1479d26 [Mina Lee] Use scala variable instead of hardcoding Specify project to build for net-inst package instead of adding exluding projects everytime zeppelin have new interpreter da9080a [Mina Lee] Update hadoop profile from 2.4 to 2.6 (cherry picked from commit f8c11d1) Signed-off-by: Mina Lee <minalee@apache.org>
### What is this PR for? This is to improve the stability of sync mechanism when `get` from some backend storage fails (e.g. corrupt file, network issues). ### What type of PR is it? Bug Fix | Hot Fix ### Todos * [x] - handle exception ### What is the Jira issue? [ZEPPELIN-1961](https://issues.apache.org/jira/browse/ZEPPELIN-1961) ### How should this be tested? CI green ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #1895 from khalidhuseynov/fix-stability/sync-fail and squashes the following commits: aa1e199 [Khalid Huseynov] catch failed get command (cherry picked from commit e94d5c0) Signed-off-by: Mina Lee <minalee@apache.org>
### What is this PR for? Reflect effects caused by changing the default notebook storage VFSNotebookRepo to GitNotebookRepo. ### What type of PR is it? [Documentation] ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: Jun Kim <i2r.jun@gmail.com> Closes #1903 from tae-jun/patch-3 and squashes the following commits: 60448da [Jun Kim] [DOCS] Reflect changed default storage to doc (cherry picked from commit 982cc0d) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
### What is this PR for? There is a deadlock in concurrent cron job execution with release resource option. `Scenario`: Two notebook run with cron job that release resource after job finished. In `Notebook.CronJob.execute()` method: `T1. note.runAll(); // locked paragraphs(lock) and wait to interpreterSettings(lock)` `T2. notebook.getInterpreterFactory().restart() //locked(interpreterSettings) and wait for paragraphs(lock) during jobAbort.` This will trigger a deadlock that cause zeppelin hang. ### What type of PR is it? [Bug Fix ] ### Todos * [x] - Fix this by avoid acquire lock in job abort method. ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1941 ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: victor.sheng <victorsheng@qiniu.com> Closes #1891 from OopsOutOfMemory/fix_dead_lock_cronjob and squashes the following commits: 517fdfa [victor.sheng] fix cron job with release resource option dead lock (cherry picked from commit 215599c) Signed-off-by: Jongyoul Lee <jongyoul@apache.org>
…ting interpreter setting ### What is this PR for? This PR would only restart the trigger user's interpreter rather than all the interpreter. So that restarting won't affect other users. ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1770 ### How should this be tested? Tested manually. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1846 from zjffdu/ZEPPELIN-1770 and squashes the following commits: 5ee076d [Jeff Zhang] fix scoped mode and add unit test 8cb28a3 [Jeff Zhang] ZEPPELIN-1770. Restart only the client user's interpreter when restarting interpreter setting (cherry picked from commit ae1cb05) Signed-off-by: Jongyoul Lee <jongyoul@apache.org>
### What is this PR for? It's my misunderstanding of `SPARK_VER` in travis. It is only used for downloading spark distribution. We need to specify spark profile explicitly for building with specific version of spark. This PR add new profile for spark 2.1 and fix the build issue with spark 2.1.0 because `SecurityManager` changes its constructor signature in spark 2.1 ### What type of PR is it? [Bug Fix ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1918 ### How should this be tested? Build with spark 2.1.0 and tested it manually as below screenshot. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1880 from zjffdu/ZEPPELIN-1918 and squashes the following commits: 8f87459 [Jeff Zhang] update release script 34772e0 [Jeff Zhang] update build doc for spark 2.1 5efdb11 [Jeff Zhang] fix unit test and address comments def502f [Jeff Zhang] ZEPPELIN-1918. Fix build with Spark 2.1.0 (cherry picked from commit 9bc4dce) Signed-off-by: Felix Cheung <felixcheung@apache.org>
### What is this PR for? Changing visualization package version from helium menu, sometimes fail. This PR fixes the problem and providing a unittest. ### What type of PR is it? Bug Fix ### Todos * [x] - remove package from node_module and let npm download again before bundle the package. * [x] - add unittest. ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1969 ### How should this be tested? Unittest HeliumVisualizationFactoryTest.switchVersion() ensure the fix. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1900 from Leemoonsoo/fix_helium_version_switch and squashes the following commits: 540497f [Lee moon soo] fix style e9f2811 [Lee moon soo] Make download package everytime bundle to workaround inconsistent behavior of npm install (cherry picked from commit d61cd99) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? Add support for jceks stored password instead of using password in clear text. This security enhancement prevents any user from reading clear passwords from interpreter json using shell/py/spark etc. #1315 is the parent PR which fixed similar a issue in Active Directory (shiro.ini config). ### What type of PR is it? Improvement ### Todos ### What is the Jira issue? ZEPPELIN-1935 ### How should this be tested? Create a keystore file using the hadoop credential commandline, for this the hadoop commons should be in the classpath. `hadoop credential create jdbc.password -provider jceks://file/user/zeppelin/conf/zeppelin.jceks` Use the jceks file and the key to configure jdbc interpreter. Example interpreter setting: #### Following are the supported settings for backward compatibility - Settings with username and jceks ``` default.driver org.postgresql.Driver default.jceks.credentialKey jdbc.password default.jceks.file jceks://file/tmp/zeppelin.jceks default.url jdbc:postgresql://rkamath-local-1:5432/ default.user rk-user ``` - Settings with user name and clear text password ``` default.driver org.postgresql.Driver default.url jdbc:postgresql://rkamath-local-1:5432/ default.user rk-user default.password password1 ``` ### Screenshots (if appropriate) <img width="1392" alt="screen shot 2017-01-10 at 7 02 12 pm" src="https://cloud.githubusercontent.com/assets/2031306/21808016/5e602982-d767-11e6-88f9-3d15b9a7f0b8.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Renjith Kamath <renjith.kamath@gmail.com> Closes #1881 from r-kamath/ZEPPELIN-1935 and squashes the following commits: 5cc4db1 [Renjith Kamath] ZEPPELIN-1935 revert wildcard imports dfabe3a [Renjith Kamath] Merge branch 'master' of https://github.com/apache/zeppelin into ZEPPELIN-1935 e62088a [Renjith Kamath] ZEPPELIN-1935 fix log message d41d56c [Renjith Kamath] ZEPPELIN-1935 Add jceks stored password support for jdbc interpreter (cherry picked from commit 04d3454) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
### What is this PR for? Livy 0.3 support cancel operation, this PR is to support cancel in livy interpreter. First we would check the livy version, then based on the livy version, we would call the livy rest api to cancel the statement. ### What type of PR is it? Improvement | Feature ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1432 ### How should this be tested? Tested manually, because cancel is only avaible in livy 0.3 which is not released yet. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1859 from zjffdu/ZEPPELIN-1432 and squashes the following commits: 83eaf83 [Jeff Zhang] minor update 200ca71 [Jeff Zhang] address comments 1cbeb26 [Jeff Zhang] add zeppelin.livy.pull_status.interval.millis 070fea0 [Jeff Zhang] ZEPPELIN-1432. Support cancellation of paragraph execution (cherry picked from commit 2fcfaa8) Signed-off-by: Felix Cheung <felixcheung@apache.org>
### What is this PR for? It should point [HeliumVisualizationFactory.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationFactory.java) not [HeliumVisualizationPackage.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationPackage.java) ### What type of PR is it? Documentation | HotFix ### What is the Jira issue? N/A ### How should this be tested? click `HeliumVisualizationFactory` link in [this section](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#3-create-and-load-visualization-bundle-on-the-fly) :) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1904 from AhyoungRyu/fix/deadlink and squashes the following commits: 60ac6c9 [AhyoungRyu] Fix deadlink in writingzeppelinvisualization.md (cherry picked from commit 425abe3) Signed-off-by: ahyoungryu <ahyoungryu@apache.org>
### What is this PR for? currently when executing cron job, backend doesn't know who initiated cron job (with subsequent save) unless user puts his name. This PR adds user name by default by keeping compatibility with current workflow. ### What type of PR is it? Improvement ### Todos * [x] - add user on front ### What is the Jira issue? [ZEPPELIN-1963](https://issues.apache.org/jira/browse/ZEPPELIN-1963) ### How should this be tested? go and set cron job ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #1898 from khalidhuseynov/cron-user and squashes the following commits: 30dc440 [Khalid Huseynov] add logged cron executing user (cherry picked from commit 8daf325) Signed-off-by: Mina Lee <minalee@apache.org>
* Keyboard events are broadcasted to components in lower tree * Focus was getting transferred to the lower paragraphs, causing a chaining effect * Making emit synchronous fixes the problem [Bug Fix] * https://issues.apache.org/jira/browse/ZEPPELIN-2448 * Open a notebook with three or more paragraphs (A, B, C, D) one below the other * Hide editor in B and C * Try to navigate A to D * The focus is passed through all four paragraphs * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: sravan <sravans2011@gmail.com> Closes #2290 from sravan-s/ZEPPELIN-2448 and squashes the following commits: a01ba7c [sravan] Fix paragraph navigation issue (cherry picked from commit d82f42d) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? A minor tweak for handling session. ### What type of PR is it? [Improvement] ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #2302 from prabhjyotsingh/ImproveSession and squashes the following commits: b9f9f0c [Prabhjyot Singh] improve session (cherry picked from commit 129741c) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
### What is this PR for? After appveyor ci is enabled for windows, PR build status shows red cross because of missing .appveyor. This PR add skeleton appveyor.yml. ### What type of PR is it? Feature ### Todos * [x] - Add .appveyor.yml ### What is the Jira issue? https://issues.apache.org/jira/browse/INFRA-14019 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #2303 from Leemoonsoo/appveyor and squashes the following commits: 5d13259 [Lee moon soo] add basic .appveyor.yml (cherry picked from commit 1ff5453) Signed-off-by: Lee moon soo <moon@apache.org>
Minor code fixes for the livy package. The code fixes include : Fixing a typo in a classname - BaseLivyInterprereter to BaseLivyInterpreter Removing an unused variable in BaseLivyInterpreter Removing unused imports in a few classes Refactoring https://issues.apache.org/jira/browse/ZEPPELIN-2465 No need to test as there is no change in funcionality * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: Benoy Antony <benoy@apache.org> Closes #2297 from benoyantony/refactor and squashes the following commits: bd6d8ff [Benoy Antony] ZEPPELIN-2465 Minor code fixes for the livy package (cherry picked from commit 55cb6b8) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? After the merge of #2302 breaks authentication. ### What type of PR is it? [Hot Fix] ### Todos * [x] - Fix selenium logout issue (flaky test) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #2304 from prabhjyotsingh/hotfix/ImproveSession and squashes the following commits: 94ba9e7 [Prabhjyot Singh] check if modal window is present, and then close it f993b59 [Prabhjyot Singh] improve session (cherry picked from commit 6c4ccf3) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
### What is this PR for? The example in the doc would fail due to typo, straightforward fix. ### What type of PR is it? [Hot Fix] ### Todos * [ ] - Task ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #2307 from zjffdu/doc_hotfix and squashes the following commits: 133fe72 [Jeff Zhang] [HOTFIX]. Minor doc fix for back-end-angular.md (cherry picked from commit 2a06292) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
Change-Id: Iaad10a69983036e84b766a22fbc32113b926b60d ### What is this PR for? With ZEPPELIN-2288 we restored the check of the Origin field for websocket requests. Unfortunately the current implementation will deny the request if the Origin HTTP header is empty, even if the zeppelin.server.allowed.origins is * This patch enables websocket requests without Origin in the HTTP header if the zeppelin.server.allowed.origins=*. This fixes the work behind a restrictive reverse proxy (or behind Apache Knox) ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2468 ### How should this be tested? It could be tested with curl as described in ZEPPELIN-2288, but I added additional unit test, so the change has been covered on unit test level. ### Screenshots (if appropriate) N/A ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: Elek, Márton <elek@users.noreply.github.com> Closes #2299 from elek/ZEPPELIN-2468 and squashes the following commits: d95bb41 [Elek, Márton] [ZEPPELIN-2468] Enable websocket without Origin if allowed.origins is * (cherry picked from commit 73ae291) Signed-off-by: Lee moon soo <moon@apache.org>
…menu This is to fix incorrect appearance of tooltip inside version control menu Improvement * [x] - fix/remove tooltip [ZEPPELIN-2479](https://issues.apache.org/jira/browse/ZEPPELIN-2479) go to `version control` menu in notebook action bar of note before: <img width="689" alt="screen shot 2017-05-02 at 3 32 23 pm" src="https://cloud.githubusercontent.com/assets/1642088/25606467/62f0901c-2f4c-11e7-95ef-c22f1df410be.png"> after:  * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #2306 from khalidhuseynov/fix/ZEPPELIN-2479 and squashes the following commits: ac4e651 [Khalid Huseynov] add css class (cherry picked from commit 8e96d8b) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? Fixing ZEPPELIN-2382: A fresh install of Zeppelin 0.7.1 failed to start on a Windows due to the use of [getPosixFilePermissions](https://docs.oracle.com/javase/7/docs/api/java/nio/file/Files.html#getPosixFilePermissions(java.nio.file.Path,%20java.nio.file.LinkOption...)) This method fails on Windows with an UnsupportedOperationException - however, recovering (that is ignoring the exception) appears to have no negative effects. (For a discussion on this related to a different project see, e.g., GoogleCloudPlatform/cloud-code-intellij#937 ) ### What type of PR is it? [Bug Fix] ### Todos * [x] - Have the binary distribution checked by the reporter of [ZEPPELIN-2382] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2382 ### How should this be tested? Check if clean distribution runs on Windows. Important: Ensure that HADOOP_HOME points to a folder containing bin/winutils.exe since this pull request does not include a fix for https://issues.apache.org/jira/browse/ZEPPELIN-2438 (which is part of a separate pull request). ### Screenshots (if appropriate) N/A ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Christian Fries <email@christian-fries.de> Closes #2305 from cfries/windows-compatiblity-interpreter-binding and squashes the following commits: e3b5738 [Christian Fries] Added graceful exception handling if posix permission is not available 096fed6 [Christian Fries] Merge branch 'master' into apache/master 3635ed8 [Christian Fries] [ZEPPELIN-2375]: Avoid modification of CLASSPATH variable. (cherry picked from commit fb80bf7) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? There is wrong description and incorrect configuration defined in comment in LdapRealm.java. Since the documentation at (http://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/security/shiroauthentication.html) does not mention LdapRealm, the information should be correct in the code comments at the least. ### What type of PR is it? Documentation ### What is the Jira issue? N/A ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Vipin Rathor <v.rathor@gmail.com> Closes #2330 from VipinRathor/fix-LdapRealm-description and squashes the following commits: 73148e3 [Vipin Rathor] [minor] Remove incorrect configuration and fix description of LdapRealm (cherry picked from commit 5fde8c2) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
### What is this PR for? This PR fixes a security hole in documentation when 'SIMPLE' authentication mechanism is defined in Shiro configuration (http://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/security/shiroauthentication.html). With that, user can log in without entering his/her password. Zeppelin documentation should recommend the correct value which is 'simple'. ### What type of PR is it? Documentation ### What is the Jira issue? N/A ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Vipin Rathor <v.rathor@gmail.com> Closes #2331 from VipinRathor/fix-SIMPLE-auth-doc and squashes the following commits: a1f0e48 [Vipin Rathor] [minor] Replace 'SIMPLE' auth with 'simple' auth everywhere in documents (cherry picked from commit 95980c7) Signed-off-by: Lee moon soo <moon@apache.org>
…etion Deletion of a notebook requires locking interpreterSettings. If the deletion is delayed , then lock is not released. At that point, we cannot run any notebook because everything is waiting to lock interpreterSettings. Looking at the code, there is no reason to lock the InterpreterSettings object in InterpreterSettingManager.removeNoteInterpreterSettingBinding. Similarly in InterpreterSettingManager.getNoteInterpreterSettingBinding only interpreterSettingBinding is accessed and its already a thread safe object. So we can remove synchronization on InterpreterSettings Bug Fix https://issues.apache.org/jira/browse/ZEPPELIN-2463 Being a concurrency issue, it is difficult to test. Please see the comments in the jira to see the issue experienced on a production zeppelin server. * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: Benoy Antony <benoy@apache.org> Closes #2296 from benoyantony/ZEPPELIN-2463 and squashes the following commits: 6f28d74 [Benoy Antony] replace check and remove with remove 0e0bb60 [Benoy Antony] fix checkstyle warnings 67f1514 [Benoy Antony] ZEPPELIN-2463 Avoid Locking interpreterSettings during Notebook deletion (cherry picked from commit d376844) Signed-off-by: Lee moon soo <moon@apache.org>
…h-0.7) ### What is this PR for? Use debounce in search input to avoid the slow search. See more:  ### What type of PR is it? [Improvement] ### Todos NONE ### What is the Jira issue? [ZEPPELIN-2512](https://issues.apache.org/jira/browse/ZEPPELIN-2512) ### How should this be tested? 1. Create many notes with different names. (50+) 2. Search using note name filter in home and navbar. 3. Do the same thing for interpreters in the interpreter page ### Screenshots (if appropriate) NONE ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO Author: 1ambda <1amb4a@gmail.com> Closes #2324 from 1ambda/ZEPPELIN-2512/add-debounce-for-search-inputs and squashes the following commits: 20292fb [1ambda] feat: Add debounce for interpreter search input b792ee5 [1ambda] feat: Add debounce for note name filter (cherry picked from commit 164db07) Signed-off-by: Lee moon soo <moon@apache.org>
… failing ### What is this PR for? Basically what happens is, if a user login using full name with suffix then the user impersonation fails, as the HDFS expects username without the suffix. This is because the username is passed to underlying components with suffix and got rejected in security layer with IllegalArgumentException ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * [ZEPPELIN-2530](https://issues.apache.org/jira/browse/ZEPPELIN-2530) ### How should this be tested? - Enable AD authentication - set `activeDirectoryRealm.principalSuffix` in shiro.ini - now try to login with the full user name (in my example its zepplintestdomain.com) ### Screenshots (if appropriate) Before: <img width="1439" alt="screen shot 2017-05-11 at 7 01 24 pm" src="https://cloud.githubusercontent.com/assets/674497/25951758/44d8adda-367c-11e7-82c1-ecbe2737e13a.png"> After: <img width="1440" alt="screen shot 2017-05-11 at 7 00 47 pm" src="https://cloud.githubusercontent.com/assets/674497/25951766/47fbc470-367c-11e7-8d14-31465a4db8bf.png"> ### Questions: * Does the licenses files need update? n/a * Is there breaking changes for older versions? n/a * Does this needs documentation? n/a Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #2337 from prabhjyotsingh/ZEPPELIN-2530 and squashes the following commits: f135eb4 [Prabhjyot Singh] validate user string for null/empty before sending it to AD server 5a02759 [Prabhjyot Singh] ZEPPELIN-2530: Zeppelin user impersonation with domain name suffix is failing (cherry picked from commit 07a5b15) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
… when getProgress is called
### What is this PR for?
When using %livy.sql interpreter following error is logged into interpreter log:
`ERROR [2017-05-17 15:01:32,897] (
{pool-1-thread-1}
TThreadPoolServer.java[run]:296) - Error occurred during processing of message.
java.lang.NullPointerException
at org.apache.zeppelin.livy.BaseLivyInterpreter.getProgress(BaseLivyInterpreter.java:178)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:121)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:558)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1899)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1884)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)`
and zeppelin server log:
`ERROR [2017-05-17 15:01:44,004] (
{JobProgressPoller, jobId=20170511-200435_1144682471}
JobProgressPoller.java[run]:58) - Can not get or update progress
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getProgress(RemoteInterpreter.java:468)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:121)
at org.apache.zeppelin.notebook.Paragraph.progress(Paragraph.java:334)
at org.apache.zeppelin.scheduler.JobProgressPoller.run(JobProgressPoller.java:55)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getProgress(RemoteInterpreterService.java:321)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getProgress(RemoteInterpreterService.java:306)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getProgress(RemoteInterpreter.java:465)
... 3 more`
This happens because this.livyVersion is never assigned in LivySparkSQLInterpreter: https://github.com/apache/zeppelin/blob/master/livy/src/main/java/org/apache/zeppelin/livy/LivySparkSQLInterpreter.java#L63
### What type of PR is it?
[Bug Fix]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2564
### How should this be tested?
New test added to verify that livyVersion is not null
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: sergeymazin <sergey.mazin@pipedrive.com>
Closes #2350 from sergeymazin/master and squashes the following commits:
3b95f5f [sergeymazin] Merge branch 'master' of https://github.com/sergeymazin/zeppelin
b506753 [sergeymazin] Check sparkInterpreter for null and move test
630520a [sergeymazin] Check sparkInterpreter for null and move test
c29c984 [sergeymazin] LivySparkSQLInterpreter to use getProgress of sparkInterpter
84db2d2 [sergeymazin] LivySparkSQLInterpreter throws NullPointerException when getProgress is called
(cherry picked from commit 05af3bf)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>
### What is this PR for? There is the chance to have a RemoteServerInterpreter hang forever during shutdown ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-2502] ### How should this be tested? Unit test provided for the fix. ### Questions: * Is there breaking changes for older versions? * Does this needs documentation? Author: andrea <andrea.peruffo1982@gmail.com> Closes #2322 from andreaTP/processHang and squashes the following commits: e58483e [andrea] [ZEPPELIN-2502] RemoteInterpreterServer hang forever during shutdown (cherry picked from commit c7c9aa1) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? Currently we can not build on branch-0.7 The cause is a missed try catch. So, I fixed this part. ### What type of PR is it? Hot Fix ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <cloverheartsdev@gmail.com> Closes #2353 from cloverhearts/missing-try-catch and squashes the following commits: 8a9ea5c [CloverHearts] missing try catch
…ront-end user. ### What is this PR for? Run all paragraphs API (http://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/rest-api/rest-notebook.html#run-all-paragraphs) does not run all paragraph as front-end user. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * [ZEPPELIN-2555](https://issues.apache.org/jira/browse/ZEPPELIN-2555) ### How should this be tested? Testing steps in screenshot ### Screenshots (if appropriate) Before:  After:  ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #2348 from prabhjyotsingh/ZEPPELIN-2555 and squashes the following commits: 13350c2 [Prabhjyot Singh] add runAll(AuthenticationInfo authenticationInfo) methond (cherry picked from commit f12bc26) Signed-off-by: Prabhjyot Singh <prabhjyotsingh@gmail.com>
This PR implements interpreter output message limit. `ZEPPELIN_INTERPRETER_OUTPUT_LIMIT` env variable or `zeppelin.interpreter.output.limit` jvm property can set limit of the interpreter output message in byte. The limit applied to only TEXT and TABLE type output, not in HTML or other types. Improvement * [x] - Task https://issues.apache.org/jira/browse/ZEPPELIN-1976 try to print more than the limit ``` %spark (1 to 10000).foreach(i=> println(s"Print line ${i} times") ) ```  * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1908 from Leemoonsoo/ZEPPELIN-1976 and squashes the following commits: 639868b [Lee moon soo] update description a9b4139 [Lee moon soo] Truncate output (cherry picked from commit 14d13de) Signed-off-by: Mina Lee <minalee@apache.org>
Proxy configuration implementation in Helium bundle factory. Used by Node, NPM and YarnPkg installers. [Improvement] * https://issues.apache.org/jira/browse/ZEPPELIN-2152 Trigger Helium plugins behind proxy * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Nelson Costa <nelson.costa85@gmail.com> Closes #2363 from necosta/zeppelin2152 and squashes the following commits: f681e73 [Nelson Costa] [ZEPPELIN-2152] Added documentation 5e29cca [Nelson Costa] [ZEPPELIN-2152] Fixed format issues f55e6e2 [Nelson Costa] [ZEPPELIN-2152] Fixed bug in secure/insecure proxy. Added proxy for HeliumOnlineRegistry d9a086a [Nelson Costa] [ZEPPELIN-2152] Added proxy config support in Helium bundle factory (cherry picked from commit 8748005) Signed-off-by: Lee moon soo <moon@apache.org>
Contributor
|
Hi, @simulight. |
Emergency fix for npe when calling Helium and with no proxies env variables set. Bug Fix https://issues.apache.org/jira/browse/ZEPPELIN-2152 * clone new zeppelin repository * unset http_proxy/https_proxy env variables (if set) * build ` mvn clean package -DskipTests;` * start zeppelin instance * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Nelson Costa <nelson.costa85@gmail.com> Closes #2380 from necosta/zeppelin2152-patch and squashes the following commits: cb25cd7 [Nelson Costa] [ZEPPELIN-2152] Fix for npe in Helium loading when no proxies are set (cherry picked from commit 88c5c3c) Signed-off-by: Lee moon soo <moon@apache.org>
We found that Livy doesn't work under kerberos and ssl, this is due to a bug when constructing KerberosRestTemplate. This PR fix this issue. [Bug Fix] * [ ] - Task * https://issues.apache.org/jira/browse/ZEPPELIN-2584 Unfornatelly it is difficult to add system test, so I manually tested it in a secure cluster. * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: root <root@ctr-e133-1493418528701-48413-01-000004.hwx.site> Closes #2367 from zjffdu/ZEPPELIN-2584 and squashes the following commits: 18b23dc [root] [ZEPPELIN-2584]. Livy doesn't work under kerberos and ssl (cherry picked from commit e3ba23a) Signed-off-by: Jeff Zhang <zjffdu@apache.org>
Contributor
|
@simulight , Could you close this PR and create a new one ? This PR is mixed with other commits. |
This PR fixes issue described in https://issues.apache.org/jira/browse/ZEPPELIN-2577 by adding .endsWith method. Bug Fix https://issues.apache.org/jira/browse/ZEPPELIN-2577 Build this PR and make sure built-in visualization is displayed in ie11 * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #2384 from Leemoonsoo/ZEPPELIN-2577 and squashes the following commits: 40c6370 [Lee moon soo] update style 1b3129c [Lee moon soo] polyfill .endswith (cherry picked from commit beb6027f27cd5194b85f13d98c54e9acac4229b7) Signed-off-by: Lee moon soo <moon@apache.org>
### What is this PR for? **This PR is created for branch-0.7** **#2318 was already merged into master** Use single `Dockerfile` for each release since [apache infra uses tag pushes](https://issues.apache.org/jira/browse/INFRA-12781) to build an image. - https://issues.apache.org/jira/browse/INFRA-12781 After release process finishes, dockerhub will build using the pushed tag. ### What type of PR is it? [Improvement] ### What is the Jira issue? [ZEPPELIN-2492](https://issues.apache.org/jira/browse/ZEPPELIN-2492) ### How should this be tested? 1. `./dev/change_zeppelin_version.sh 0.8.0-SNAPSHOT 0.7.1` 2. Check that version is properly set: `vi scrtips/docker/zeppelin/bin/Dockerfile` 3. Build docker image `cd scripts/docker/zeppelin/bin; docker build -t zeppelin:0.7.1 ./` 4. Run the image: `docker run -p 8080:8080 --rm --name zeppelin zeppelin:0.7.1` ### Screenshots (if appropriate) NONE ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO Author: 1ambda <1amb4a@gmail.com> Closes #2388 from 1ambda/ZEPPELIN-2492/use-single-dockerfile-for-each-tag-branch07 and squashes the following commits: 64b3fe0 [1ambda] docs: Update docker.md 1471096 [1ambda] feat: Add dockerfile for tag push
### What is this PR for? Currently allowing authentication for selected roles/groups of an LDAP realm is not possible. The LDAPRealm allows for mapping of roles to groups but only allows authorization on URLs with respect to groups. No group based checks are carried out during authentication. This PR allows for group based authentication using LdapRealm. ### What type of PR is it? [Improvement] ### Todos * [x] - Merge #932 - This PR also merges changes from 932 so that needs to be merged first. ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2539 ### How should this be tested? Build and configure `shiro.ini` to use the LdapRealm and verify that the realm works as before along with the added functionality of allowing only certain user groups for authentication if the `allowedRolesForAuthentication` config is set in the init. If this configuration is absent authentication should work as before without verifying roles. A sample shiro.ini is pasted here for testing purposes. ``` [main] ldapRealm = org.apache.zeppelin.realm.LdapRealm ldapRealm.userDnTemplate = uid={0},ou=people,dc=my-company,dc=net ldapRealm.searchBase = dc=my-company,dc=net ldapRealm.userSearchBase = ou=people,dc=my-company,dc=net ldapRealm.groupSearchBase = ou=groups,dc=my-company,dc=net ldapRealm.contextFactory.url = ldaps://auth.my-company.net:636 ldapRealm.contextFactory.authenticationMechanism = simple ldapRealm.userObjectClass = posixAccount ldapRealm.groupObjectClass = posixGroup ldapRealm.authorizationEnabled = true ldapRealm.memberAttribute = memberUid ldapRealm.memberAttributeValueTemplate=uid={0},ou=people,dc=my-company,dc=net ldapRealm.rolesByGroup = GLOBAL_ADMINS:admin,HKG_USERS:user ldapRealm.allowedRolesForAuthentication = admin,user ldapRealm.userSearchAttributeName = uid sessionManager = org.apache.shiro.web.session.mgt.DefaultWebSessionManager shiro.loginUrl = /api/login securityManager.sessionManager = $sessionManager securityManager.sessionManager.globalSessionTimeout = 86400000 securityManager.realms = $ldapRealm [urls] /api/version = anon /api/login = authc /api/login/logout = authc /** = authc, roles[admin,user] ``` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Y (documentation updated in PR) Author: Sohaib Iftikhar <iftikhar.sohaib@gmail.com> Closes #2354 from sohaibiftikhar/ldaprealm and squashes the following commits: f706b22 [Sohaib Iftikhar] Added role based authentication(not to be confused with authorization) for shiro (cherry picked from commit 169fb74) Signed-off-by: Lee moon soo <moon@apache.org>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
request for supporting insert iframe of one paragraph to the other paragraph, this is very useful to increase the reusement and integration of paragraphs coded by different languages.