GithubHelp home page GithubHelp logo

Data provenance about dat HOT 4 CLOSED

dat-ecosystem avatar dat-ecosystem commented on August 16, 2024
Data provenance

from dat.

Comments (4)

pietercolpaert avatar pietercolpaert commented on August 16, 2024 1

Related: git can be described using prov-o (w3c), dat should be too: http://git2prov.org/ (by @tdn)

from dat.

joehand avatar joehand commented on August 16, 2024 1

There have been significant changes in Dat since previous version. The 1.0 should have much better support for data provenance! Please continue similar discussion in https://github.com/datproject/discussions/issues, thanks.

from dat.

max-mapper avatar max-mapper commented on August 16, 2024

At the moment I'm planning on supporting row-level provenance. I was considering cell-level but there was significant overhead.

In terms of supporting a particular provenance standard in dat core, thats a perfect opportunity to write a module on top of dat. I am happy to make dat itself present all of the required APIs to support serializing/parsing provenance standards in higher level modules.

Previous relevant discussions:

from dat.

elf-pavlik avatar elf-pavlik commented on August 16, 2024

I start looking at issue of provenance in LevelGraph. In case data comes from a document very likely we will just store original document outside of a graph with UUID or hash and use LevelGraph tripple properties to store this UUID or hash for each triple to track its origin.
We also started discussing use of quads and named graphs in levelgraph/levelgraph#43
I'll try to remember to share update with you once we implement something! Also first I should catch up with your work here 😄

from dat.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.