doytsujin / eventnative

EventNative is an open-source data collection framework

EventNative is an open source, high-performance, event collection service. Capture all events your application generates and stream to your preferred Data Warehouse with current support for RedShift and BigQuery. EventNative can be deployed in 1-click on the infrastructure of your choice.

Quick Start

The fastest way to get started is one click deploy on Heroku with:

For production deployment we suggest Docker:

• Official ksense/eventnative image
• Docker deployment guide
• Also, you can build EventNative from sources and use configuration management of your choice

Features

• Drop-in Segment & Google Analytics Backend: No need to modify your existing tracking code if you're using analytics.js or Google Analytics, just add a few lines of JavaScript and you're set!

• Self Hosted Tracker: Don't want to send your user data to third parties? Use our self hosted tracker.

• Capture Events stoped by AdBlock: Since EventNative is hosted on your domain, you get events for all users; not just those withour AdBlock.

• Multiple Destination Support: We support Redshift, BigQuery, PostgreSQL, Snowflake (Coming Soon) and ClickHouse (Coming Soon). EventNative automatically pushes to all your configured destinations at once without additional overhead.

• High-Performance and Throughput: EventNative is written in Go with performance in mind, you're only limited by local disk performance since we write events locally prior to sending them to your data warehouse in batches. Read more about scalability here.

• Dynamic Schema and JSON Interface: EventNative parses incoming requests and adjusts the underlying schema automatically. We map JSON events to tables and create necessary columns on the fly.

• Data Enrichment: EventNative can connect with MaxMind's selfhosted DB for geo resolution to determine a user's country, city, and zip code from their IP address

• Retrospective User Recognition: Coming soon for selected destination (BigQuery, pSQL and ClickHouse).

• Mobile Application SDKs: Coming soon for iOS and Android.

Demo

We host a simple page that demonstrates how EventNative works. Once your instance is deployed, visit this page to see how tracking works.

Documentation

Please see our extensive documentation here. Key sections include:

• Deployment - Getting EventNative running on Heroku, Docker, and building from source.
• Configuration - How to modify EventNative's yaml file.
• Geo Data - Configuring data enrichment with MaxMind.
• Scaling - How to setup a distributed deployment of EventNative.

Community

We are made for developers, by developers and would love to have you join our community.

• Wiki - Check out our development wiki.
• Slack - Join our slack.
• Email - Send us an email.
• Submit a pull request!

Open Source

EventNative is developed and maintained by kSense under the MIT license. We charge for ETL from other datasources and let you connect your EventNative destination to kSense for analysis if you choose.