Comments (4)
Reorganizing or reformatting a repository is a more disruptive change than
adding new data, seems to me. I'd swap minor and patch.
Also, for data even more than code, it's important to adopt semver's
"anything goes during 0.x" policy.
On Jan 17, 2014 6:02 AM, "Juan Batiz-Benet" [email protected]
wrote:
In software, we've come to use things like semver http://semver.org/ to
ensure programs and their dependencies interoperate well.Problems with this:
- Forcing data publishers/researchers to follow a scheme does not seem
fun or fruitful.- semver focuses on API changes, and does not apply well to data.
Paths:
Don't enforce anything. See what happens.
This is flexible to "whatever you want to do." This is liable to yield
a proliferating mess of "version" schemes. This seems like the worst thing
to do.Find an existing standard that makes sense and use it.
Are there well established (and sane) data versioning standards? I'm
not too familiar with what's out there.data semver (or more researcher-friendly: Semantic Data Versioning),
a semver fork tuned for data purposes. Perhaps something like this:Given a version number MAJOR.MINOR.PATCH, increment the:
MAJOR version when you REMOVE data.
MINOR version when you ADD data in a backwards-compatible manner, and
PATCH version when you CLEAN or REFORMAT data, without ADDING or REMOVING values.Discussion welcome.
—
Reply to this email directly or view it on GitHubhttps://github.com//issues/13
.
from data.
Reorganizing or reformatting a repository is a more disruptive change
Makes sense. I was considering data values the files attempt to describe, but in reality, files changing at all will cause a host of problems for any programs computing on them. Let's try this again:
Given a version number MAJOR.MINOR.PATCH, increment the:
MAJOR version when you modify data or make incompatible file changes,
MINOR version when you add data in a backwards-compatible manner, and
PATCH version when you make backwards-compatible changes to metadata files.
metadata
above is unfortunately broad and unclear. I refer to accompanying files that provide information on the data (docs, Datafile, etc). What would be a better word? Perhaps ancillary files
? Perhaps the "backwards-compatible" description will get the point across.
"anything goes during 0.x" policy.
Indeed :)
from data.
I think "metadata" is good as it stands. It means "data about the data". As
long as the changes are backwards-compatible and "the data itself" can
reasonably be considered unchanged, that's a patch version.
It might do to an include an illustrative example or two, e.g. "adding, to
a repository of astronomical images, new files describing the sky
conditions during each capture would qualify as a patch update, if no new
images are also included".
On Jan 17, 2014 9:16 AM, "Juan Batiz-Benet" [email protected]
wrote:
Reorganizing or reformatting a repository is a more disruptive change
Makes sense. I was considering data values the files attempt to describe,
but in reality, files changing at all will cause a host of problems for any
programs computing on them. Let's try this again:Given a version number MAJOR.MINOR.PATCH, increment the:
MAJOR version when you modify data or make incompatible file changes,
MINOR version when you add data in a backwards-compatible manner, and
PATCH version when you make backwards-compatible changes to metadata files.metadata above is unfortunately broad and unclear. I refer to
accompanying files that provide information on the data (docs, Datafile,
etc). What would be a better word? Perhaps ancillary files? Perhaps the
"backwards-compatible" description will get the point across."anything goes during 0.x" policy.
Indeed :)
—
Reply to this email directly or view it on GitHubhttps://github.com//issues/13#issuecomment-32608741
.
from data.
I like the "data semver", neat idea!
from data.
Related Issues (20)
- `data get` + dependencies
- implement data blob check
- implement data blob hash
- Use a `.data` directory
- Download Progress
- Messages out of order HOT 2
- feedback regarding new user onboarding HOT 9
- Generate a Datafile with command like `data init` HOT 1
- Disambiguate `data get [dataset]` and `data get` from Datafile HOT 2
- local blobstore? global?
- support `data get <URL>`
- data publish goes where? HOT 2
- bug: data pack check fails if files are deleted.
- make sure http:// is in urls for indexes
- 'data config edit' should use $EDITOR
- 'data manifest' on empty dir
- `data publish` should require a version
- data manifest: merge add/hash HOT 1
- data blob: interface should not use manifest. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from data.