Add support to Spark 2.1 in Sparkling Water

[exalate-issue-sync]

Add support to Spark 2.1 in Sparkling Water

Spark 2.1 have global table persistence in 2.1 which would really help us in our use case so wanted to see where you were at with sparkling water. We’d no longer have to use our thrift server in single session and would be able to have multiple flow sessions access the same spark tables and queries. Let me know if we can help in any way to get that working.

[exalate-issue-sync]

Vlad Patryshev commented: The problem is, in Spark 2.1 columns that are plain classes (not compound) and not primitives, are considered "nullable". Which contradicts the previous approach and our assumptions. I've changed the test a little bit, but we have to think on how do we treat it in general.

[DinukaH2O]

JIRA Issue Migration Info

Jira Issue: SW-326
Assignee: Michal Malohlava
Reporter: Avkash Chauhan
State: Resolved
Fix Version: 2.1.0
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#196

[hasithjp]

JIRA Issue Migration Info Cont'd

Jira Issue Created Date: 2017-02-06T07:54:02.506-0800