Home

Shark is a large-scale data warehouse system for Spark designed to be compatible with Apache Hive. It can answer Hive QL queries up to 30 times faster than Hive without modification to the existing data nor queries. Shark supports Hive's query language, metastore, serialization formats, and user-defined functions.

List of unsupported Hive features: Provides list of Hive features that we don't support yet. If you are interested in trying out Shark and use some of the following features, please drop us a note and we will see how we can accommodate.

Developer Guide: For people who are interested in contributing. We don't have much here yet. Will slowly add content to it.

EC2 Guide: We will provide a tutorial on setting up a Shark cluster on EC2 soon!

Hive Test Status: Coming soon with a list of tests passing/failing.