yangxb2010000 / delay-schedule Goto Github PK
View Code? Open in Web Editor NEW分布式、高可用的延迟调度系统、可以配合消息队列实现延迟任务队列
delay-schedule's People
Contributors
Stargazers
Watchers
Forkers
wanghui2333delay-schedule's Issues
Schedule Server一期 对RabbitMQ、Kafka的支持
- 考虑设计delaytask实际执行逻辑的可扩展架构
- 基于上述可扩展架构实现延时任务队列（对接RabbitMQ、Kafka）
Client端一期开发
- 监听Zookeeper获取SchedulerServer List
- 根据taskId sharding调用对应的ScheduleServer
- 尽可能的把传输层做抽象，暂时考虑基于grpc或http与ScheduleServer通信。
一期 Client端支持SpringBoot
Client需要适配Springboot
二期预研工作：Schedule Server
- 添加Metric逻辑
- 收集Schedule Server运行时各种指标，如：延时任务是否到期执行，执行延时任务时堵塞情况
- 考虑实现Dashboard管理系统，可以直观查看Scheduler Server的各种运行时状态，并可以操作
- 对Schedule Server做benchmark性能测试
Schedule Server 一期task正常流程处理逻辑
- 实现schedule server add task、持久化DB、执行task的核心逻辑
- 基于上面的核心逻辑对外暴露http接口，与client可以联调
- 实现schedule server支持动态设置覆盖slot（rebalance、重启时会调用该逻辑）
Schedule Server 一期 实现基于Jdbc的DelayTask持久化逻辑
实现基于Jdbc的DelayTask持久化逻辑
二期预研工作：Client
- Client实现Metrics统计功能
- Client考虑支持其他rpc、如：grpc
- Client考虑支持多语言
ScheduleServer 一期 对zookeeper相关逻辑处理
- 服务启动时注册到zookeeper
- 基于zookeeper实现选主
- 主Schedule Server需要负责监听SchedulerServer列表，如果有变化执行rebalance操作
- 监听自己的zookeeper上当前Schedule Server负责的slot，如果有变化就重新设置slot
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.