AngersZhuuuu/spark
Apache Spark
Apache Spark
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
Python SQL Parser and Transpiler
Gluten: Plugin to Double SparkSQL's Performance
Flink 中文视频课程(持续更新...)
API for interacting with ChatGPT using Python and from Shell.
Open source Java implementation for Raft consensus protocol.
A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
overview of sql concepts
Apache Spark Website
Optimized Analytics Package for Spark* Platform
Apache Hive
Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
A Spark Atlas connector to track data lineage in Apache Atlas
Upserts, Deletes And Incremental Processing on Big Data.
An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.
Mirror of Apache Hadoop
Apache Parquet
Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
Scripts and code examples. Includes Spark notes, Jupyter notebook examples for Spark, Impala and Oracle.
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Lessons in the Fundamentals of Scala
ACL Management for Apache Spark SQL with Apache Ranger. This library has been contributed to https://github.com/apache/submarine as a sub-module, and that module can still be used individually. The project here will no longer be updated. If you have any questions please go to https://github.com/apache/submarine/tree/master/docs/submarine-security/spark-security/README.md to learn how to use and give feedback to the apache submarine community by following https://submarine.apache.org/community/contributors.html
Apache Flink
SparkCube is an open-source project for extremely fast OLAP data analysis. SparkCube is an extension of Apache Spark.