Comments (1)
release note
注意: v1.1.0 版本有不兼容变更,请参考如下不兼容变更列表,合理选择升级方式
不兼容变更
- v1.1.0 支持表结构自动升级框架,使用截止到v1.0.2的表结构/数据为默认基础版本,如果你的版本未在 v1.0.2+ 则必须先按照官网中的升级教程进行升级到 v1.0.2 的表结构,如你的版本为 v1.0.2+ 则可以直接升级,程序会自动执行,且不会影响历史数据
- 由于 flink-cdc 贡献至 apache 基金会导致新版本包名变更,无法做兼容变更,在 dinky-v1.1.0 及以上版本,dinky 将使用新的包名依赖引入,因此要求你的 flink-cdc 的依赖则必须升级至 flink-cdc v3.1+,否则无法使用
- 移除打包时的 scala版本区分,只采用 scala-2.12 进行开发,不再支持scala-1.11.x
New Feature
- 新增 flyway 表结构升级框架
- 任务目录支持灵活排序
- 实现任务级别的权限控制,并支持不同权限控制策略
- 优化添加租户时自动添加管理员用户关联
- 新增任务提交卡死状态下可以直接杀死该进程功能
- 支持 k8s 部署dinky
- 实现数据预览
- 新增数据开发中支持 UDF 注入配置
- 添加整库同步功能(cdcsource) sink 端的表名称映射,正则匹配修改映射
- 新增 Dashboard 页面
- 新增 Paimon 数据源类型
- 新增 SQL-Cli
BugFix
- 修改k8s的account.name值问题&添加deleteCluster时Conf初始化问题
- 修复 flink-cdc 在 application 模式下丢失sql的问题
- 修复复制任务时,任务创建时间未重置问题
- 修复任务列表定位问题
- 解决提交 Jar 任务时用户 Jars 中的自定义类无法编译的问题
- 修复 企微-app模式告警信息不正确的问题
- 修复 flink-1.19 无法提交任务的问题
- 修复启动脚本无法支持 jdk11 的问题
- 修复集群实例无法删除的问题
- 修复 UDF 在 Flink SQL 任务中找不到类的问题
优化
- 优化资源配置中的提示词
- 优化 mysql 数据源类型的 DDL 生成逻辑
- 优化一些前端依赖问题,并优化一些前端提示信息
- 优化资源中心的复制路径功能,支持dinky 内多种应用场景
- 优化监控功能,使用 dinky 的配置中心中监控功能开关来控制整体 dinky 内的所有监控
- 优化一些前端判断逻辑
重构
- 将告警规则移动至注册中心下的告警路由下
- 移除 paimon 作为存储监控介质,改为 sqllite,并不强依赖于 hadoop-uber 包(hadoop 环境下除外),并支持定期清理
- 重构监控页面,移除部分内置服务监控
文档
- 增加 k8s 部署 dinky 文档
- 优化 docker 部署文档
- 添加整库同步功能(cdcsource) sink 端的表名称映射等相关文档
from dinky.
Related Issues (20)
- [Bug] [develop module] yarn-application Submit failed
- [Bug] Git project page refreshes infinitely
- [Bug] [CDCSOURCE] MysqlCDC to paimon with hive catalog error HOT 4
- [Feature][studio] Support FlinkSQL Procedures
- [Bug] [Module Name] Bug title After deploying dinky-release-1.19-1.1.0.tar.gz for the first time, there is no data. When I click on the workbench, an exception is reported. HOT 2
- [Bug] [web] The enable button in the form does not have a default value when creating a new Git project HOT 1
- [Bug] [admin] Type mismatch caused by tenantId field in git project entity class when creating a new git project item HOT 2
- [Bug] [admin] Cannot create a new git project item after deleting all list items
- dinky-app-1.19-1.1.0-jar-with-dependencies.jar path error HOT 1
- [Optimization][Data Studio] Recommend display the oracle schema in pagination HOT 1
- [Bug] [Data Development] When submitting a task, I found that there is no application cluster to choose from. HOT 1
- [Optimization] [Module Name] Failed to submit task using yarn-application HOT 3
- [Bug] The dispatcher returned from the ServletContext does not support asynchronous dispatching HOT 15
- [Bug] Caused by: java.lang.IllegalArgumentException: EndPoint is not set HOT 10
- [Feature][*] Release 1.1.1 HOT 1
- Exception in thread "main" java.lang.NoSuchMethodError: org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli is reported when starting yarn-application in the hadoop cluster /Option$Builder;flink version is 1.18, hadoop cluster is version 3.3.6 HOT 7
- [Optimization][web] When there are too many tables in a database of the data source, the tree list of data source details expands and gets stuck. HOT 1
- During oracle cdc synchronization, the databasename and sid of the oracle source database are different, resulting in the inability to connect to the database. HOT 5
- AggTable is faulty in this document HOT 2
- [Document][doc] Update ICP
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dinky.