CodingSinger/lmstfy

Implements task queue in Golang which based on Redis storage

★ 0Forks 0GitHub ↗Compare

README

Let Me Schedule Tasks For You (lmstfy)

Build Status Go Report Card Coverage Status GitHub release GitHub release date LICENSE GoDoc

lmstfy(pronounce /'lam.si.fai/) is a simple task queue (or job queue) service, providing the following features:

  • basic job queue primitives: PUBLISH, CONSUME and DELETE via HTTP API
  • support extra lifecycle management of jobs:
    • job TTL (time-to-live)
    • job delay trigger (at second granularity)
    • job auto-retry
    • dead letter
  • namespace/queue level metrics
  • token consume/produce rate limit

lmstfy itself doesn't handle data storage, it delegates the storage to the Redis or Redis Sentinel currently (a file based storage backend is under implementing). So data integrity and durability is in the hand of redis, we use AOF and replication on our production env to ensure that.

Who use lmstfy

Meitu

SDK for lmstfy

Build and Run

# to build the server binary, the target file would be inside _build dir
$ make

# setup redis server
$ redis-server &

# run the lmstfy server
$ ./_build/lmstfy-server -c config/demo-conf.toml

You can use ./scripts/token-cli to manage the namespace and token

DOCs


Dashboard

Internal

Detailed internal implementation looks like:

job flow

Contributors

git-hulkliguangboruoshanJoker-hhoifchensunnyYesphet

Issues