civisanalytics / async-graph-data-flow Goto Github PK

I only stumbled across this project by accident, but love what you have done.

You might be interested in looking at some of the things that the Numaflow Project has done for more inspiration.

Numaflow runs jobs in Kubernetes, so the comparisons are only skin deep, but they are creating graphs for processing pipelines and have some nice capabilities that you may be able to implement here.

In particular, I think that the "Edge Conditions" are fairly easy to understand, but incredibly powerful. They allow the users to create routing rules, by encode filter logic into the edges.

I do not have a need for this project right now, but I will certainly keep it in mind and circle back the next time I do.

Thank you for building this.