Presto Hive StorageHandler - outputFormat should not be accessed from a null StorageFormat Error

[pkasinathan]

Hi,

I'm working with presto 0.170 version. Everything is working awesome, except Hive Custom Storage Handler external tables.

Getting outputFormat should not be accessed from a null StorageFormat error. Please help to fix.

Table DDL:

hive > show create table flights_hbase
CREATE EXTERNAL TABLE flights_hbase (
flight_id string,
flightnum string
)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cols:flightnum")
TBLPROPERTIES ("hbase.table.name" = "flights");
hive >

Added required storage handler and related jars to plugin connector dir on all worker and master nodes and restarted presto

$ ls -ltr /usr/local/presto-server-0.170/plugin/hive-hadoop2/h*
-rwxr-xr-x. 1 root        root        24164995 Mar 26 19:15 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hadoop-apache2-0.10.jar
-rwxr-xr-x. 1 root        root          736658 Mar 26 19:15 /usr/local/presto-server-0.170/plugin/hive-hadoop2/httpclient-4.5.2.jar
-rwxr-xr-x. 1 root        root        26409112 Mar 26 19:15 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hive-apache-1.2.0-1.jar
-rwxr-xr-x. 1 root        root          326724 Mar 26 19:15 /usr/local/presto-server-0.170/plugin/hive-hadoop2/httpcore-4.4.4.jar
-rwxr-xr-x. 1 root        root          901834 Mar 26 19:15 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hive-dwrf-0.8.2.jar
-rwxr-xr-x. 1 prabhu prabhu  1366504 Mar 31 23:58 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hbase-client.jar
-rwxr-xr-x. 1 prabhu prabhu   557343 Mar 31 23:58 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hbase-common.jar
-rwxr-xr-x. 1 prabhu prabhu  4753129 Mar 31 23:58 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hbase-protocol.jar
-rwxr-xr-x. 1 prabhu prabhu  4457393 Mar 31 23:59 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hbase-server.jar
-rwxr-xr-x. 1 prabhu prabhu   118707 Mar 31 23:59 /usr/local/presto-server-0.170/plugin/hive-hadoop2/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar
$

Querying on Presto:

presto:default> select * from flights_hbase limit 5;
Query 20170331_235243_00026_8wscc failed: outputFormat should not be accessed from a null StorageFormat
presto:default>

Thanks
Prabhu

[dain]

Can you run with the --debug command line option and post the full stack trace?

[dain]

Oh, never mind the --degug request. Presto does not support the HBaseStorageHandler, so this isn't going to work anyway. Currently, I don't think anyone is considering adding support for this.

[pkasinathan]

Thanks @dain!

Does presto support other custom storage handlers? I'm trying to query Elastic Search External Hive table through presto and getting the same error.

presto:default> select * from acc_elastic;
Query 20170603_230413_00004_cwtww failed: outputFormat should not be accessed from a null StorageFormat
presto:default>

Please advice.

Thanks
Prabhu

[dain]

Presto does not support any Hive StorageHandlers.

…

-dain

On Jun 3, 2017, at 4:04 PM, Prabhu Kasinathan ***@***.***> wrote: Thanks @dain! Does presto support other custom storage handlers? I'm trying to query Elastic Search External Hive table through presto and getting the same error. presto:default> select * from acc_elastic; Query 20170603_230413_00004_cwtww failed: outputFormat should not be accessed from a null StorageFormat presto:default> Please advice. Thanks Prabhu — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[danielhaviv]

Is there a way to make Presto ignore such tables (metadata refresh encounters an exception)?

[kokosing]

Is there a way to make Presto ignore such tables (metadata refresh encounters an exception)?

Not yet today.

This issue looks like a duplicate #6972