ConeyLiu/uniffle
Uniffle is a high performance, general purpose Remote Shuffle Service.
Uniffle is a high performance, general purpose Remote Shuffle Service.
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Official Rust implementation of Apache Arrow
RayDP: Distributed data processing library on Ray by running popular big data frameworks like Apache Spark on Ray. RayDP seamlessly integrates with other Ray libraries to make it simple to build E2E data analytics and AI pipeline.
Apache Iceberg C++
Apache PyIceberg
Apache Parquet
Apache Iceberg
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Apache Doris(Incubating) is an MPP-based interactive SQL data warehousing for reporting and analysis.
A better notebook for Scala (and more)
Optimized Analytics Package for Spark Platform
Performance Analysis Tool
An implementation of a deep learning recommendation model (DLRM)
A fast and simple framework for building and running distributed applications.
Mirror of Apache Spark
This is a set of simple programs that can be used to explore the features of a parallel platform.
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
HiBench is a big data benchmark suite.
Apache Flink
A simple version of Guava cache
Mirror of Apache Kafka
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
Deep Learning for humans
Deep Learning Book Chinese Translation
Learning Process
Weld is a runtime and language for accelerating data analytics frameworks
A curated list of awesome Machine Learning frameworks, libraries and software.
Netty project - an event-driven asynchronous network application framework