hhy5277 / incubator-shardingsphere

Distributed database middleware

ShardingSphere - Distributed Database Middleware Ecosphere

Official website: https://shardingsphere.apache.org/

Document

Overview

ShardingSphere is an open-source ecosystem consisted of a set of distributed database middleware solutions, including 3 independent products, Sharding-JDBC, Sharding-Proxy & Sharding-Sidecar (todo). They all provide functions of data sharding, distributed transaction and database orchestration, applicable in a variety of situations such as Java isomorphism, heterogeneous language and cloud native.

Aiming at reasonably making full use of the computation and storage capacity of database in distributed system, ShardingSphere defines itself as a middleware, rather than a totally new type of database. As the cornerstone of many enterprises, relational database still takes a huge market share. Therefore, at current stage, we prefer to focus on its increment instead of a total overturn.

All available releases are not Apache releases, Apache releases will begin from version 4.0.0

Sharding-JDBC

Sharding-JDBC defines itself as a lightweight Java framework that provides extra service at Java JDBC layer. With client end connecting directly to the database, it provides service in the form of jar and requires no extra deployment and dependence. It can be considered as an enhanced JDBC driver, which is fully compatible with JDBC and all kinds of ORM frameworks.

• Applicable in any ORM framework based on Java, such as JPA, Hibernate, Mybatis, Spring JDBC Template or direct use of JDBC.
• Based on any third-party database connection pool, such as DBCP, C3P0, BoneCP, Druid, HikariCP.
• Support any kind of database that conforms to JDBC standard: MySQL，Oracle，SQLServer and PostgreSQL for now.

Sharding-Proxy

Sharding-Proxy defines itself as a transparent database proxy, providing a database server that encapsulates database binary protocol to support heterogeneous languages. Friendlier to DBA, the MySQL version provided now can use any kind of client access (such as MySQL Command Client, MySQL Workbench, etc.) that is compatible of MySQL protocol to operate data.

• Totally transparent to applications, it can be used directly as MySQL.
• Applicable to any kind of compatible of client end that is compatible of MySQL protocol.

Sharding-Sidecar(TBD)

Sharding-Sidecar (TBD) defines itself as a cloud native database agent of Kubernetes or Mesos environment, in charge of all the access to database in the form of DaemonSet. Through a decentralized and zero-cost solution, it provides a mesh layer interacting with database, i.e., Database Mesh, also referred to as database grid.

Database Mesh emphasizes on how to connect distributed database access application with the database. Focusing on interaction, it effectively organizes the interaction between messy applications and database. The application and database that use Database Mesh to visit database will form a large grid system, where they just need to be put into the right position accordingly. They are all governed by mesh layer.

	Sharding-JDBC	Sharding-Proxy	Sharding-Sidecar
Database	Any	MySQL	MySQL
Connections Cost Number	High	Low	High
Heterogeneous Language	Java Only	Any	Any
Performance	Low loss	Relatively High loss	Low loss
Decentralization	Yes	No	No
Static Entry	No	Yes	No

Hybrid Architecture

Sharding-JDBC adopts decentralized architecture, applicable to high-performance light-weight OLTP application developed with Java; Sharding-Proxy provides static entry and heterogeneous language support, applicable for OLAP application and the sharding databases management and operation situation.

ShardingSphere is an ecosphere consists of multiple endpoints together. Through mixed use of Sharding-JDBC and Sharding-Proxy and unified sharding strategy by one registry center, ShardingSphere can build application system applicable to all kinds of situations. Architects can adjust the system architecture to the most applicable one to current business more freely.

Features

Data Sharding

• Database sharding & Table sharding
• Read-write splitting
• Distributed primary key

Distributed Transaction (Doing)

• XA transaction
• BASE transaction

Database Orchestration

• Dynamic configuration
• Fusing & Disabling
• Tracing
• Elastic scaling out (Planing)

Roadmap