hongxiuzhe Goto Github PK
Type: User
Type: User
2015 ali中间件比赛项目,1. 通信模块: 涉及到了消息架构设计,每一个主题分配1-2个队列,这个是可以横向增加,考虑到了一个主题有多个消费者订阅,而且还有过滤条件,为了负载均衡,对应的队列投递消息是根据随机数对队列数取膜完成的。以上是内存队列。 2. 持久化系统:因为考虑到机器坏掉,broker不可用等等原因导致的消息丢失,就需要每次收到的消息必须及时落盘,这个就是比赛优化的重中之重。为此设计了一个小型的文件系统,借鉴阿里的rocketmq. 用一个大的日志文件,一般1G大小每个,和内存队列的结构映射到实体队列。整个日志文件是顺序文件,每条消息固定大小,里面有对应的队列号,消息号,还有长度等等。这个方便恢复消息到实体队列用的。 同步刷盘,异步刷盘,持久化必须可靠,所以一般是同步刷盘到日志文件,日志文件定时异步刷盘到实体队列,实体队列里面是索引,消息的本体在日志文件里面。为了加快大面积的写入速度,用了内存映射:内存映射文件首先将外存上的文件映射到内存中的一块连续区域,被当成一个字节数组进行处理,读写操作直接对内存进行操作,而后再将内存区域重新映射到外存文件,这就节省了中间频繁的对外存进行读写的时间,大大降低了读写时间
2016年阿里中间件性能挑战赛复赛
2016阿里中间件性能挑战赛初赛程序
SQL-based streaming analytics platform at scale
Learning Resources And Links Of Machine Learning(updating)
Most common RPC framework used throughout Baidu, with 600,000+ instances and 500+ kinds of services, called "baidu-rpc" inside Baidu.
Java implementation for Baidu RPC
酷玩 Spark: Spark 源代码解析、Spark 类库等
:books: Computer Science Learning Notes
第三届阿里巴巴中间件性能挑战赛复赛程序——模拟阿里双十一分布式数据同步
A Python implementation of Deep Belief Networks built upon NumPy and TensorFlow with scikit-learn compatibility
Drawio GitHub Integration
drools examples, spring boot drools examples
study
《Go语言四十二章经》详细讲述了Go语言规范与语法细节以及在开发中常见的误区;通过对标准库包和著名第三方包的实际运用,来启发读者深刻理解Go语言的核心思维,仔细琢磨经典代码设计模式,引领读者进入Go语言开发的更高阶段。
Distributed SQL query engine written in Go for big data
Java网络编程学习
JDK源码阅读笔记
阿里巴巴第三届中间件性能挑战赛初赛程序——进程内消息引擎
Basic Sources for MIT 6.824 Distributed Systems Class
A high-performance message oriented middleware for the 1st Alibaba Middleware Performance Competition final and rank 9th among 1000 teams
一些技术笔记
腾讯高性能图计算框架Plato
Distributed SQL query engine for big data
Go support for Google's protocol buffers
Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang
Notes talking about the design and implementation of Apache Spark
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.