TheR1sing3un/paimon-vector-index
Apache Paimon Vector Index: pure Rust IVF-PQ for data lake vector search.
Committer @apache Now focus on AI & Data Infra.
Apache Paimon Vector Index: pure Rust IVF-PQ for data lake vector search.
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Lance Format and Ray
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
A cloud native implementation for Apache RocketMQ 5.0
Spark integrations for working with Lance datasets
Upserts, Deletes And Incremental Processing on Big Data.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Distributed query engine providing simple and reliable data processing for any modality and scale
OpenDAL: Access data freely, painlessly, and efficiently
Signing HTTP requests without heavy SDKs.
Benchmark for vector databases.
Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.
Fluss is a streaming storage built for real-time analytics.
Apache Iceberg
Apache DataFusion SQL Query Engine
Apache DataFusion Comet Spark Accelerator
Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
My record about learning the course MIT-6.824
RobustMQ is a next-generation, high-performance, cloud-native, converged message queue that is compatible with multiple mainstream message queuing protocols and has complete Serveless capabilities.
bluedis!
My Blog
Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
Apache Parquet Java
Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.
Apache Iceberg
Apache Flink