Comments (5)
I want to try it. Could you please assign it to me?
Welcome, you can just create PR for this. I think this may need multiple PRs.
from paimon.
I want to try it. Could you please assign it to me?
from paimon.
@JingsongLi, IMO, it's no need to create multiple PRs to solve this issue. @TyrantLucifer, you could create multiple commits for different modules in one PR. Please keep one commit for initial PR.
from paimon.
Hi @TyrantLucifer , we don't just use the new ReadBuilder and WriteBuilder APIs either, we need to get rid of the FileStoreTable as well, our best practice is to use Catalog to create the Table and then follow through with the operations.
from paimon.
@JingsongLi, IMO, it's no need to create multiple PRs to solve this issue. @TyrantLucifer, you could create multiple commits for different modules in one PR. Please keep one commit for initial PR.
One commit for initial PR? But create multiple commits for different modules in one PR? Can you explain more?
from paimon.
Related Issues (20)
- [Feature] Default parallelism in SparkWriter also needs to consider numShufflePartitions HOT 1
- [Feature] Remove limitation of flink catalog which can not create database with properties.
- [Feature] Reduce redundant shuffle for spark dynamic bucket writes HOT 1
- [Bug] Flink write to paimon, the commit time last very long, event more than 5 min
- [Feature] make jdbc catalog support using database location to create table.
- [Bug] flink sql-gateway use paimon-generic (use Hive metastore)
- [Feature] Introduce clone Action and Procedure
- [Feature] Improve the parallelism of Flink database compression commit operators
- [Bug] After the flink job written to Paimon modifies `sink.parallelism`, the job will not be able to recover from the checkpoint HOT 3
- [Feature] Optimize splits generator for unaware bucket mode
- [Feature] Support Hive 4.0.0
- [Feature] Flink batch reads the paimon partition table jobManager oom and optimizes its partition scanning
- [Feature] Supports flink-cdc write data to branch
- [Bug] Config index-ttl for Cross Partitions Upsert will result RocksDBException(value's length less than timestamp's) in bootstrap stage HOT 1
- [Feature] 1-1 mapping between paimon buckets and kafka partitions HOT 2
- [Bug] Hilbert-curve dependency is missed in the built JAR file of paimon-flink/paimon-xxx module
- [Feature] Reduce S3 API calls HOT 1
- [Bug] In combined mode, an error will be reported if the number of buckets is not set HOT 1
- [Bug] Hidden dangers in lookup function HOT 1
- [Feature] Skip listPartitions scan for FlinkRecomputeStatisticsProgram
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paimon.