This is an internal version of Shark for DianPing inc. which is forked from amplab Shark. Latest version is on branch cosmos-shark-0.8, based on amplab tag v0.8.0 and merged commits from amplab hive0.11 branch. We also fixed a few bugs, see more here
Shark is a large-scale data warehouse system for Spark designed to be compatible with Apache Hive. It can answer Hive QL queries up to 100 times faster than Hive without modification to the existing data nor queries. Shark supports Hive's query language, metastore, serialization formats, and user-defined functions.
Shark 0.8.0 requires:
- Scala 2.9.3
- Hive 0.9
- Spark 0.8.x