[FEATURE REQUEST] Queue Adapters (eg: SQS, GCP Pub/Sub etc) about asynq

[anupriya17]

A Pubsub Interface like this will help, I just copied the redis pubsub methods:

type Message struct {
	Channel      string
	Payload      string
}

type PubSub interface {
	Subscribe(ctx context.Context, channels ...string) error
	PSubscribe(ctx context.Context, patterns ...string) error
	SSubscribe(ctx context.Context, channels ...string) error
	Unsubscribe(ctx context.Context, channels ...string) error
	PUnsubscribe(ctx context.Context, patterns ...string) error
	SUnsubscribe(ctx context.Context, channels ...string) error
	Ping(ctx context.Context, payload ...string) error
	ReceiveTimeout(ctx context.Context, timeout time.Duration) (interface{}, error)
	Receive(ctx context.Context) (interface{}, error)
	ReceiveMessage(ctx context.Context) (*Message, error)
	Channel(opts ...ChannelOption) <-chan *Message
	Close() error
}

type ChannelOption func(*channelOptions)

type channelOptions struct {
	size        int
	maxInterval int64
}

func WithChannelSize(size int) ChannelOption {
	return func(opts *channelOptions) {
		opts.size = size
	}
}

func WithMaxInterval(maxInterval int64) ChannelOption {
	return func(opts *channelOptions) {
		opts.maxInterval = maxInterval
	}
}

[yoshdog]

ok seems like there is already a broker interface
https://github.com/hibiken/asynq/blob/master/internal/base/base.go#L715-L755

So we would just need to implement one for every type... eg: SQS, RabbitMQ, PUB SUB etc...

[anupriya17]

Thanks. broker interface depends on redis pubsub currently.
https://github.com/hibiken/asynq/blob/master/internal/base/base.go#L751

IMO to decouple pub/sub to its own interface. We don't need all the methods

[anhoder]

Looking forward to this feature👀

[bowenli86]

+1