Comments (8)
Hi Ted,
I'd actually suggest you to use the DataSketches implementation of KLL or ReqSketch for your testing and benchmarking. Their implementation is production-quality and also in Java, making the comparison meaningful, and they are under the Apache license. I believe the purpose of this repo is to demonstrate proof of concept.
from streaming-quantiles.
from streaming-quantiles.
DataSketches very recently incorporated a Java implementation of the same relative error quantiles algorithm as here, and actually their code is based on my Python code in this repo (which was implementing the algorithm from this paper: https://arxiv.org/abs/2004.01668 ).
The Java implementation is not released yet (that should be done soon) but you can find it here: https://github.com/apache/datasketches-java/tree/master/src/main/java/org/apache/datasketches/req
I was helping them to develop it and I think it's pretty much ready to be used in experiments.
from streaming-quantiles.
from streaming-quantiles.
from streaming-quantiles.
I'm fine with changing it, but this needs to be decided by Edo (the license header for relative error code here was already change to the Apache license).
from streaming-quantiles.
from streaming-quantiles.
Hi Ted, sorry for just now noticing this thread.
This repo is a research project. The line "It should NOT be used for any commercial purposes" is a warm recommendation more than a legal usage guideline...
I'm happy to soften the language if you think it's worth doing. Regardless, apache datasketches should be the authoritative implementation for KLL, not my untested research python code...
from streaming-quantiles.
Related Issues (3)
- How to set k? HOT 1
- Sampler? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from streaming-quantiles.