Implements Hive Input/Output format to use vineyard as the storage backend

[vegetableysm]

What do these changes do?

Related issue number

Fixes #1420

Refer to:
PR #1554
PR #1551
PR #1548
PR #1552

[netlify]

✅ Deploy Preview for v6d ready!

Name	Link
🔨 Latest commit	72bd707
🔍 Latest deploy log	https://app.netlify.com/sites/v6d/deploys/64f57f5a760e6d0007ca80f1
😎 Deploy Preview	https://deploy-preview-1520--v6d.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[sighingnow]

/cc @vegetableysm

A quick note about string array and large string array: string array cannot contains chars more than. 2^32-1 while large string array can.

In vineyard, vineyard::StringArray is arrow's large string array (LargeVarCharArray in java) and you shouldn't put string array to vineyard in any time. When hive gives you string array, cast it to large string array first then put to vineyard.

[sighingnow]

LGTM.

[sighingnow]

@vegetableysm please

• cleanup all your temporary System.out.println() lines
• fixes the codecy warnings: https://github.com/v6d-io/v6d/pull/1520/checks?check_run_id=16061188591
• squash all commits into one and rebase against main branch.

Thanks!

[vegetableysm]

performance test

prepare data

create table vineyard_table(
                            src_id int,
                            dst_id int)
        row format serde "io.v6d.hive.ql.io.VineyardSerDe"
        stored as
            INPUTFORMAT 'io.v6d.hive.ql.io.VineyardInputFormat'
            OUTPUTFORMAT 'io.v6d.hive.ql.io.VineyardOutputFormat'
        LOCATION "vineyard:///opt/hive/data/warehouse/vineyard_table";

create table nomal_table(
                            src_id int,
                            dst_id int);

create table hive_test_data_livejournal(
                            src_id int,
                            dst_id int
        )
        row format serde 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
        stored as textfile ;
        load data local inpath "file:///opt/hive/data/warehouse/soc-livejournal.csv" into table hive_test_data_livejournal;

insert test

insert into vineyard_table select * from hive_test_data_livejournal; 
insert into nomal_table select * from hive_test_data_livejournal; 

select test

select * from vineyard_table where src_id = 1;
select * from nomal_table where src_id = 1;