Aletheia is a framework for implementing high volume, datum (event) based, producer-consumer data pipelines. Its key features are:
- Routing based data delivery
- Fine grained visibility (Breadcrumbs)
- Multiple serialization formats
- Schema evolution support
Aletehia supports the following producers/consumers out-of-the-box:
- Kafka 0.10.2.1 (Producer, Consumer, Kafka Streams)
- Kafka 0.9 (production and consumption)
- Log files (production only)
Custom producer/consumer types are easy to write. See Wiki - Endpoints for details.
Building Alethia
Clone the repo (or download the sources):
git clone https://github.com/outbrain/Aletheia.git
Build the project:
mvn clean install -f Aletheia/pom.xml
Further Info
Aletheia has been developed by the Data Infrastructure team at Outbrain.