Kerberos for SW not loading JAAS module

[exalate-issue-sync]

Starting SW with:

$SPARK_HOME/bin/spark-submit --class water.SparklingWaterDriver --conf spark.ext.h2o.kerberos.login=true --conf spark.ext.h2o.user.name=markc --conf spark.ext.h2o.login.conf=/home/markc/kerb.conf assembly/build/libs/sparkling-water-assembly-1.6.8-all.jar

Does not load the JAAS module which is required for Kerberos security through Jetty.
{{03-10 10:21:21.442 127.0.0.1:54325 5314 #r thread INFO: ----- H2O started -----
03-10 10:21:21.469 127.0.0.1:54325 5314 #r thread INFO: Build git branch: rel-turing
03-10 10:21:21.469 127.0.0.1:54325 5314 #r thread INFO: Build git hash: 912599584db78b24b13c8f5f4669dd72aed1b684
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build git describe: jenkins-rel-turing-7
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build project version: 3.10.0.7 (latest version: 3.10.4.1)
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build age: 5 months and 18 days
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Built by: 'jenkins'
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Built on: '2016-09-19 23:29:27'
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO:
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: *** Your H2O version is too old! Please download the latest version 3.10.4.1 from http://h2o.ai/download/ ***
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO:
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Processed H2O arguments: [-name, sparkling-water-markc_-1010099465, -ga_opt_out, -log_level, INFO, -baseport, 54321, -ip, localhost, -log_dir, /home/markc/H2O/sparkling-water-1.6.8/h2ologs]
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Java availableProcessors: 12
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java heap totalMemory: 981.5 MB
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java heap maxMemory: 981.5 MB
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java version: Java 1.8.0_121 (from Oracle Corporation)
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: JVM launch parameters: [-Xms1g, -Xmx1g]
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: OS version: Linux 4.4.0-64-generic (amd64)
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Machine physical memory: 62.11 GB
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: X-h2o-cluster-id: 1489170080520
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: User name: 'markc'
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Opted out of sending usage metrics.
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: IPv6 stack selected: false
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: tun0 (tun0), 172.17.0.241
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: eno1 (eno1), fe80:0:0:0:8acf:cdce:bb5:3d0d%eno1
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: eno1 (eno1), 192.168.1.117
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: lo (lo), 0:0:0:0:0:0:0:1%lo
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: lo (lo), 127.0.0.1
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Selected H2O.CLOUD_MULTICAST_IF: name:lo (lo) doesn't support multicast
03-10 10:21:21.484 127.0.0.1:54325 5314 #r thread INFO: Internal communication uses port: 54326
03-10 10:21:21.484 127.0.0.1:54325 5314 #r thread INFO: Listening for HTTP and REST traffic on http://127.0.0.1:54325/
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: H2O cloud name: 'sparkling-water-markc_-1010099465' on localhost/127.0.0.1:54325, discovery address /229.138.64.85:58762
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: If you have trouble connecting, try SSH tunneling from your local machine (e.g., via port 55555):
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: 1. Open a terminal and run 'ssh -L 55555:localhost:54325 markc@127.0.0.1'
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: 2. Point your browser to http://localhost:55555
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: Log dir: '/home/markc/H2O/sparkling-water-1.6.8/h2ologs'
03-10 10:21:21.502 127.0.0.1:54325 5314 #r thread INFO: Cur dir: '/home/markc/H2O/sparkling-water-1.6.8'
03-10 10:21:21.509 127.0.0.1:54325 5314 #r thread INFO: Using HDFS configuration from /usr/local/hadoop/conf
03-10 10:21:21.509 127.0.0.1:54325 5314 #r thread INFO: HDFS subsystem successfully initialized
03-10 10:21:21.513 127.0.0.1:54325 5314 #r thread INFO: S3 subsystem successfully initialized
03-10 10:21:21.513 127.0.0.1:54325 5314 #r thread INFO: Flow dir: '/home/markc/h2oflows'
03-10 10:21:21.521 127.0.0.1:54325 5314 #r thread INFO: Cloud of size 1 formed [localhost/127.0.0.1:54325]
03-10 10:21:21.534 127.0.0.1:54325 5314 #r thread INFO: Registered parsers: [GUESS, ARFF, XLS, SVMLight, CSV]
03-10 10:21:21.535 127.0.0.1:54325 5314 #r thread INFO: Registered 0 extensions in: 460mS
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: Registered: 129 REST APIs in: 301mS
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO:
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: Open H2O Flow in your web browser: http://127.0.0.1:54325
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: }}

Should see a JAAS message if Kerberos is loaded properly
After running:
java -jar h2o.jar -kerberos_login -login_conf /home/markc/kerb.conf -user_name markc

{{03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Multiple local IPs detected:
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: /172.17.0.241 /192.168.1.117
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Attempting to determine correct address...
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Using /192.168.1.117
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Configuring JAASLoginService (with Kerberos)
03-10 10:19:51.849 192.168.1.117:54325 5094 main INFO: Internal communication uses port: 54326
03-10 10:19:51.849 192.168.1.117:54325 5094 main INFO: Listening for HTTP and REST traffic on http://192.168.1.117:54325/}}

[DinukaH2O]

JIRA Issue Migration Info

Jira Issue: SW-353
Assignee: Jakub Hava
Reporter: Mark Chan
State: Resolved
Fix Version: 2.1.3
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#221

[hasithjp]

JIRA Issue Migration Info Cont'd

Jira Issue Created Date: 2017-03-10T10:26:36.248-0800