Comments (3)
How big are arrays?
What if set max_block_size = 1000
from clickhouse.
Yes it's hard to figure out what consumed memory without at least knowing the schema of the table and the sizes of arrays in individual rows, because if one (or several) rows have huge array they will have to be fully read and uncompressed into memory when processing the query.
Also you can notice that progress says: 359.48 thousand rows, 17.11 GB
from clickhouse.
I increased the memory and then performed a length-based sorting query, which I think is because the array length is too long. Is there an appropriate range for the length of this array? Does this mean
record{
id Int64 comment 'ID',
org_log_ids Array(String) default [],
datasource String
}
When my statement is: "SELECT id, org_log_ids, datasource FROM record LIMIT 10;", does the array field (org_log_ids) undergo aggregation, leading to excessive memory usage?
from clickhouse.
Related Issues (20)
- Unify calling of calling `client` or `local` with `clickhouse` and `ch` shortcuts
- build problem on ubuntu,v23.5.1.3174-stable,submodule build error HOT 2
- Logs populated by `DNSCacheUpdater: IPs of some hosts have been changed. Will reload cluster config` HOT 1
- [RFC] Freezing python packages HOT 3
- Logical error: 'mutation_pointer < it->second->entry->znode_name'. HOT 1
- Variant: runtime error: load of value 808482864, which is not a valid value for type Types::Which
- WITH TOTALS triggers CANNOT_INSERT_NULL_IN_ORDINARY_COLUMN
- Inserting into a table does not work if the material view that looks at this table is not deleted HOT 6
- Materialized Views with Recursive Queries
- Kafka Engine improvements RFC HOT 1
- ALTER DELETE with skip index on where clause not longer pruning parts HOT 5
- Add virtual columns `_etag`, `_last_modified`, `_storage_class` for `S3` storage. HOT 3
- Which table engine to use? HOT 1
- Unexpected result when comparing `IN` expression and integer
- Replica table stuck in read-only (after I manually edited files on disk) HOT 2
- JOIN on parameterized view fails with UNKNOWN_IDENTIFIER
- Parameter out of bound in IColumnString::insertRangeFrom (03036_dynamic_read_subcolumns)
- An option to place objects in breadth-first order for `plain` and `plain_rewritable` metadata engines
- Tests are using table names that are not supported HOT 1
- Segfault in `DB::IMergeTreeDataPart::getIndexSizeInBytes()` during `ServerAsynchronousMetrics::updateImpl`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clickhouse.