This project will take s DB schema and generate the three things:
- Create Table Scripts
- Create an external table or hive user tables
- RCFiles
- Converts big number to java big integers
- Load scripts
- Supports insert into hive 8 and 9
- Supports delta change loads
- Will soon support partitioned delta loads
- Load from local or HDFS
- Converts Dates
- Compresses Data
- Test Data
- Single or multi load test data.
This project contains the following UDFs
- BigBigInt - This supports binary numbers that are bigger then BigInt and in fact they can store numbers of any size.