leeper / data-versioning Goto Github PK

https://kgbase.com/

Need some update for the dat-protocol, that at the time that the article was written had not evolved enough, today it is bigger and more active. Also there is a dat broken link.

This may be interesting to you:

• https://gist.github.com/CMCDragonkai/b11dcd8ec0bf07459d197fd671738a5e - Version Control Diff, Patch and Merge Analysis (mostly Git)
• https://gist.github.com/CMCDragonkai/d266a3055735545447439f0fa662a0e1 - History Data Structures

I've also done work on a tree based data structure intended to represent arbitrary structures and allow fast structural editing: https://github.com/MatrixAI/js-tree-order-index It's not finished and is based on the paper dynamic hierarchal trees. http://www.vldb.org/pvldb/vol8/p986-finis.pdf

The same author has also got an interesting version tree data structure as well.

I'm interested in the key-value conclusion. If the data is highly structured, e.g. tabular or hierarchical, then I imagine that a key might be "row x column y", or for (e.g. JSON) document data, a key might be "person.addresses.home.street_number". This could potentially make the storage quite inefficient/expensive.

I think that as long as

• changesets can refer to the smallest atoms of data,
• they can be reliably applied in forward/reverse direction as required
  then storing the master version in (say) CSV or JSON format would be just as useful.

I also wonder whether mentioning the "Command/Query Responsibility Segregation" (CQRS) and Event Sourcing patterns in the Review of Existing Tools and Approaches might be useful.
https://en.wikipedia.org/wiki/Command%E2%80%93query_separation
https://martinfowler.com/eaaDev/EventSourcing.html
These can be useful when it is important to be able to undo or reconstruct sequences of operations.

I haven't read through all of the information in the README, but I came across this repo while trying to locate a project I had looked at a few weeks ago and forgot to bookmark.

It sounds like that project might be a good option to include in this list: https://github.com/attic-labs/noms

DVC.org is meant for data versioning which is almost similar to Git-SCM, we can add that in existing data-versioning tools in Readme.md