Comments (6)
I just followed instructions here:
https://github.com/ClickHouse/ClickBench#caching
Caching
If the system contains a cache for query results, it should be disabled.It is okay if the system performs caching for source data (buffer pools and similar). If the cache or buffer pools can be flushed, they should be flushed before the first run of every query.
If the system contains a cache for intermediate data, that cache should be disabled if it is located near the end of the query execution pipeline, thus similar to a query result cache.
from clickbench.
@roborourke let's add another result without flushing the cache. We can mark it "Elasticsearch (cache)".
It will be good for overall comparison.
from clickbench.
@tbragin sorry I missed that part of the methodology 🤦♂️ Thanks for pointing it out. I also misread the script I think, so it's just clearing the cache once for each query before running the query x times. That makes more sense.
@alexey-milovidov are you sure? It's ok if it doesn't fit with the overall methodology and you want to keep to that. Sorry I feel like I may be opening a can of worms here!
from clickbench.
The script flushes the cache inside the for loop, so that should be before every try.
If someone has time to add an additional result with caching for ES, great! Perhaps, in the process, all results can also be updated with latest release of Elasticsearch that's come out since the time of initial publishing.
from clickbench.
are you sure? It's ok if it doesn't fit with the overall methodology and you want to keep to that.
It's ok to add it to the repository - we have support for hiding some results by default.
So, the results will be present, but out of competition.
from clickbench.
@roborourke, let's add additional results, it will be ok.
from clickbench.
Related Issues (20)
- Databend benchmark is not valid the the latest Databend versions HOT 3
- Does the skipping index have more advantages for test dataset HOT 1
- Why is the perf of cold scan much worse than ever in the last commit of m5d.24xlarge. HOT 1
- Add YTsaurus support
- Can we get a larger dataset? HOT 1
- Add BoilingData to ClickBench HOT 14
- Doris vs Clickhouse for TPC-H HOT 1
- Update DataFusion & results
- AlloyDB benchmark results for 8 vCPU not clear
- Any plan for adding queries with window function? HOT 1
- Q17 doesn't have sorting HOT 2
- Segmentation fault running hardware.sh while running Test 17 HOT 1
- The Pinot benchmark does not have indices. HOT 7
- ClickHouse appears to run into an overflow on Q3 HOT 2
- Add YDB for comparing HOT 1
- Inaccurate table size calculation of Mysql HOT 1
- Add Quickwit support HOT 5
- feat: add Github Actions to auto generate index.html HOT 1
- Syntax error for postgresql CREATE TABLE HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clickbench.