Skip to content
Sketch adaptors for Hive.
Java
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
src
tools Minor updates Oct 8, 2019
.gitignore Update metadata files at root. Oct 3, 2019
.travis.yml Update travis.yml Oct 19, 2019
DISCLAIMER-WIP Adding license to misc files, update readme Sep 20, 2019
LICENSE update license Oct 17, 2019
NOTICE update Notice pom Oct 9, 2019
README.md Minor updates Oct 8, 2019
pom.xml update pom Oct 9, 2019

README.md

Build Status Maven Central Language grade: Java Total alerts Coverage Status

=================

DataSketches UDF/UDAF Adaptors for Apache Hive

Please refer to our website for more comprehensive information about the various sketching algorithms and how to use them.

Documentation

DataSketches Library Website

Java Core Overview

Java Core Javadocs

Hadoop Hive UDFs/UDAFs

See relevant sections under the different sketch types in Java Core Overview

Downloading Latest Release

NOTE: This component accesses resource files for testing. As a result, the directory elements of the full absolute path of the target installation directory must qualify as Java identifiers. In other words, the directory elements must not have any space characters (or non-Java identifier characters) in any of the path elements.

This is required by the Oracle Java Specification in order to ensure location-independent access to resources: See Oracle Location-Independent Access to Resources

Zip File from Apache Archive

Jar Files from Maven Central

GitHub

Build Instructions

JDK8 is Required Compiler

This DataSketches component is pure Java and you must compile using JDK 8.

Recommended Build Tool

This DataSketches component is structured as a Maven project and Maven is the recommended Build Tool.

There are two types of tests: normal unit tests and tests run by the strict profile.

To run normal unit tests:

$ mvn clean test

To run the strict profile tests:

$ mvn clean test -P strict

To install jars built from the downloaded source:

$ mvn clean install -DskipTests=true

This will create the following jars:

  • datasketches-hive-X.Y.Z-incubating.jar The compiled main class files.
  • datasketches-hive-X.Y.Z-incubating-tests.jar The compiled test class files.
  • datasketches-hive-X.Y.Z-incubating-sources.jar The main source files.
  • datasketches-hive-X.Y.Z-incubating-test-sources.jar The test source files
  • datasketches-hive-X.Y.Z-incubating-javadoc.jar The compressed Javadocs.

Dependencies

Run-time

This has the following top-level dependencies:

  • org.apache.datasketches : datasketches-java
  • org.apache.hive : hive-exec
  • org.apache.hadoop : hadoop-common
  • org.apache.hadoop : hadoop-mapreduce-client-core

Testing

See the pom.xml file for test dependencies.

Resources

Issues for datasketches-hive

Forum

Dev mailing list

You can’t perform that action at this time.