Comments (4)
This should be fixed in master (to be released in 443). Are you able to build the latest snapshot and try it to see if it works for you now?
from trino.
Tried with 440
the following scenario:
trino> create table iceberg.default.t1(id integer, data varchar);
CREATE TABLE
trino> select * from iceberg.default.t1;
id | data
----+------
(0 rows)
trino> use iceberg.default;
USE
trino:default> insert into t1 values (1, 'A');
INSERT: 1 row
trino:default> insert into t1 values (2, 'B');
INSERT: 1 row
-- trying with a filter having 2K values
trino:default: select * from t1 where id in (1, 2, ...., 2000);
Query 20240320_115100_00007_d5q3m, FINISHED, 1 node
http://localhost:8080/ui/query.html?20240320_115100_00007_d5q3m
Splits: 2 total, 2 done (100.00%)
CPU Time: 0.0s total, 47 rows/s, 14.5KB/s, 18% active
Per Node: 0.0 parallelism, 1 rows/s, 314B/s
Parallelism: 0.0
Peak Memory: 320B
1.99 [2 rows, 624B] [1 rows/s, 314B/s]
-- trying with a filter having 20K values
trino:default: select * from t1 where id in (1, 2, ...., 20000);
id | data
----+------
2 | B
1 | A
(2 rows)
Query 20240320_115145_00008_d5q3m, FINISHED, 1 node
http://localhost:8080/ui/query.html?20240320_115145_00008_d5q3m
Splits: 2 total, 2 done (100.00%)
CPU Time: 0.0s total, 105 rows/s, 32.1KB/s, 12% active
Per Node: 0.0 parallelism, 0 rows/s, 5B/s
Parallelism: 0.0
Peak Memory: 320B
2:07 [2 rows, 624B] [0 rows/s, 5B/s]
Trying on 442
the same scenario
-- trying with a filter having 20K values
trino:default: select * from t1 where id in (1, 2, ...., 20000);
id | data
----+------
2 | B
1 | A
(2 rows)
Query 20240320_120535_00003_dz7bu, FINISHED, 1 node
http://localhost:8080/ui/query.html?20240320_120535_00003_dz7bu
Splits: 2 total, 2 done (100.00%)
CPU Time: 0.1s total, 18 rows/s, 5.64KB/s, 55% active
Per Node: 0.0 parallelism, 0 rows/s, 4B/s
Parallelism: 0.0
Peak Memory: 320B
2:37 [2 rows, 624B] [0 rows/s, 4B/s]
Trying on master
the same scenario
-- trying with a filter having 20K values
trino:default: select * from t1 where id in (1, 2, ...., 20000);
id | data
----+------
2 | B
1 | A
(2 rows)
Query 20240320_120148_00003_g5krv, FINISHED, 1 node
http://localhost:8080/ui/query.html?20240320_120148_00003_g5krv
Splits: 2 total, 2 done (100.00%)
CPU Time: 0.2s total, 10 rows/s, 3.36KB/s, 61% active
Per Node: 0.2 parallelism, 1 rows/s, 572B/s
Parallelism: 0.2
Peak Memory: 320B
1.14 [2 rows, 650B] [1 rows/s, 572B/s]
from trino.
Fixed by #21146
from trino.
Thanks @findinpath @martint
from trino.
Related Issues (20)
- Flaky test TestDeltaLakeAlluxioCacheMinioAndHmsConnectorSmokeTest.testCreateOrReplaceTableConcurrently: `Read -1 bytes from cache` HOT 3
- Support CREATE VIEW in JDBC-based connectors for MS SQL Server HOT 1
- Flaky tests due to insufficient synchronization in FileHiveMetastore
- Update MERGE exception and message for jdbc connectors
- Use IcebergQueryRunner in TestIcebergRegisterTableProcedure
- Flaky `TestIcebergMinioParquetCachingConnectorSmokeTest.testDeleteRowsConcurrently`
- Incorrect evaluation for IN with failing term
- Flaky TestHiveRuntimeAdaptivePartitioningFaultTolerantExecutionJoinQueries.testJoinWithMultipleInSubqueryClauses HOT 3
- Snowflake CI keeps facing timeout HOT 4
- Documentation of Fault-tolerant-execution HOT 1
- Parameterised query does not work for either json_query or json_valaue
- How does the shared-secret secure internal communication interact with Kerberos authentication? HOT 1
- Feature request: hive.s3.skip-glacier-objects - skips restored object
- (probably) need cloud trino HOT 2
- When using Trino to optimize Iceberg tables, my table data exceeded 5 billion rows. Since Iceberg's optimization feature does not enable disk swapping, the optimization fails due to insufficient memory. Is there a solution? HOT 1
- Trino CDF issue, Shallow clone table_changes doesn't contain base_table rows
- Support remote-signing in Trino Iceberg connector
- Enable Snowflake limit pushdown test
- Flaky test TestPinotConnectorTest
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from trino.