anthrax3 / highway

Highway Project: ESB(Enterprise Service Bus), Message Center

Highway

Background

In October 2015 at JinRi.cn firm. As the business grows, We have met a big problem order-state changing notifications. However, more than 20 applications get the order-state changed info by scanning Order Database. Someday, requests from scanning and clients almost reached the maximum 32767 concurrent connections. So the database dealing with transactions become very slow because the internal queue is full and thread context switching takes up a lot of CPU time. You know all related things went into a vicious circle. So we stopped all scanning windows services, and appropriately rise maximum threshold of database connections. Two hours later everything looked as good. We just reopen 3 scanning services. So we have made a decision to build a new project “Highway” meaning the Enterprise Message Bus. I am responsible for leading the project in design and developing. I spend five days to design, and we discuss it about 6 times. we developed for 7 days and testing and Load testing took 5 days. Highway collects all message from the business systems and notifies all registered clients. it decouples message producing and message consuming. Meanwhile, Highway reserve high availability, high concurrency, scalability. And it was launched in December 2015. the Highway is comprised of four SOA services, receiver service, builder service, redo service and notify service. Nowadays, It collects nearly 1 million messages and sends out more than 10 millions messages every day. And from receiving to sending, It takes about 1 second.

Design

System Structure Diagram

the Highway is comprised with four SOA services, receiver service, builder service, redo service and notify service.

Activity Diagram

We use MQ, Redis and concurrent computing to rise performance.

System Screen Shots

System Configuration

Client-Interface Configuration

Message-Type Configuration

Message-Received Management

Message-Noticed Management

Discuss

If you have any question, please feel free to let me know.

Contact Info

Email: [email protected] City: Auckland, New Zealand.