averemee-si / kudu-kafka-connect

kudu-kafka-connect

The Kudu Sink Connector allows you to ingest data to Apache Kudu tables from Apache Kafka topic. kudu-kafka-connect does not use JDBC driver. Cuurently only one configuration is supported: kudu-kafka-connect reads definition of Kudu table and map columns of this table to fields in Apache Kafka topic.

Distribution

1. GitHub

Getting Started

These instructions will get you a copy of the project up and running on any platform with JDK8+ support.

Prerequisites

Before using kudu-kafka-connect please check that required Java8+ is installed with

echo "Checking Java version"
java -version

Installing

Build with

mvn install

Running

kudu-kafka-connect Connector's parameters

a2.kudu.masters - Kudu master server or a comma separated list of Kudu masters a2.case.sensitive.names - Use case sensitive column names (true, default) or do not (false) a2.kudu.table - Name of Kudu table a2.batch.size - Maximum number of statements to include in a single batch when inserting/updating/deleting data a2.schema.type - Type of schema used by kudu-kafka-connect: plain (JDBC Connector compatible) (default) or Debezium

Monitoring

solutions.a2.kafka.kudu.KuduSinkConnector publishes a number of metrics about the connector’s activities that can be monitored through JMX. For complete list of metrics please refer to JMX-METRICS.md

Built With

• Maven - Dependency Management

TODO

• Table auto-creation from topic information

Version history

####0.1.0 (APR-2022)

Initial release

Authors

• Aleksej Veremeev - Initial work - A2 Rešitve d.o.o.

License

This project is licensed under the Apache License - see the LICENSE file for details