Comments (17)
I can do the backend. The frontend?
from dinky.
Hello @xiaofan2022, this issue is about CDC/CDCSOURCE, so I assign it to @aiwenmo. If you have any questions, you can comment and reply.
你好 @xiaofan2022, 这个 issue 是关于 CDC/CDCSOURCE 的,所以我把它分配给了 @aiwenmo。如有任何问题,可以评论回复。
from dinky.
Support for major connectors such as flink-cdc,flink-jdbc,flink-hive,flink-hudi mainstream sql field type mapping
from dinky.
Please explain the purpose and design plan
from dinky.
Purpose: sql generation function automatically generates synchronous sql (type mapping) based on connector
Plan: First support jdbc type sql generated field type mapping
from dinky.
Purpose: sql generation function automatically generates synchronous sql (type mapping) based on connector Plan: First support jdbc type sql generated field type mapping
Can you implement this function?
from dinky.
I can do the backend. The frontend?
Thank you very much for your participation. Please clarify the front-end requirements, and we will be responsible for their implementation.
from dinky.
The front end adds different connector types (such as CDC, JDBC, Hive, Hudi) when generating SQL statements, and the back end maps the corresponding fields according to the official documentation based on the connector type.
from dinky.
The front end adds different connector types (such as CDC, JDBC, Hive, Hudi) when generating SQL statements, and the back end maps the corresponding fields according to the official documentation based on the connector type.
you can provide a map data struct example of backend . i will be design the frontend
from dinky.
The front end adds different connector types (such as CDC, JDBC, Hive, Hudi) when generating SQL statements, and the back end maps the corresponding fields according to the official documentation based on the connector type.
I understand whether it can be designed as follows
- The front end adds a drop-down box in Generate sql -> Flinksql Tag (values such as: CDC, JDBC, Hive, Hudi)
- Then select and call the interface input parameters before adding the connector type input parameters. The interface generates results based on the connector type, and then returns
how?
from dinky.
yes
from dinky.
If you want to add flink-cdc type mapping, is to add a new flink-cdc-meta, and then put the corresponding logic into flink- CDC-meta?
from dinky.
@aiwenmo What do you think?
from dinky.
Put the corresponding logic into dinky-cdc.
from dinky.
Put the corresponding logic into dinky-cdc.
It would be inappropriate to put everything in dinky-cdc. In theory, the column type information on the data source module also needs to use the type conversion here to achieve a unified effect.
from dinky.
Is it possible to maintain different conversion logic for different sources (e.g. flink-cdc,jdbc,hive,hudi) in the conversion logic corresponding to the connector?
from dinky.
Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.
你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。
from dinky.
Related Issues (20)
- [Bug] [develop module] yarn-application Submit failed
- [Bug] Git project page refreshes infinitely
- [Bug] [CDCSOURCE] MysqlCDC to paimon with hive catalog error HOT 4
- [Feature][studio] Support FlinkSQL Procedures
- [Bug] [Module Name] Bug title After deploying dinky-release-1.19-1.1.0.tar.gz for the first time, there is no data. When I click on the workbench, an exception is reported. HOT 2
- [Bug] [web] The enable button in the form does not have a default value when creating a new Git project HOT 1
- [Bug] [admin] Type mismatch caused by tenantId field in git project entity class when creating a new git project item HOT 2
- [Bug] [admin] Cannot create a new git project item after deleting all list items
- dinky-app-1.19-1.1.0-jar-with-dependencies.jar path error HOT 1
- [Optimization][Data Studio] Recommend display the oracle schema in pagination HOT 1
- [Bug] [Data Development] When submitting a task, I found that there is no application cluster to choose from. HOT 1
- [Optimization] [Module Name] Failed to submit task using yarn-application HOT 3
- [Bug] The dispatcher returned from the ServletContext does not support asynchronous dispatching HOT 15
- [Bug] Caused by: java.lang.IllegalArgumentException: EndPoint is not set HOT 10
- [Feature][*] Release 1.1.1 HOT 1
- Exception in thread "main" java.lang.NoSuchMethodError: org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli is reported when starting yarn-application in the hadoop cluster /Option$Builder;flink version is 1.18, hadoop cluster is version 3.3.6 HOT 7
- [Optimization][web] When there are too many tables in a database of the data source, the tree list of data source details expands and gets stuck. HOT 1
- During oracle cdc synchronization, the databasename and sid of the oracle source database are different, resulting in the inability to connect to the database. HOT 5
- AggTable is faulty in this document HOT 2
- [Document][doc] Update ICP
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dinky.