Comments (2)
Perhaps not much of a concern for us at this time, but this does assume that the data file is committed to git
, which is often not ideal and will fail for data > 50Mb.
I've been exploring various ways around this (e.g. see unconf issue ropensci/unconf18#51). My current strategy is to take a clue from Rich FitzJohn and upload the data as assets attached to a release. piggyback will let you do something like:
library(piggyback)
pb_upload("user/repo", tag= "data", file = "mydata.csv.gz")
url <- pb_download_url("user/repo", tag= "data", file = "mydata.csv.gz")
to construct a download url for the asset.
This should work for any individual data files up to 2GB in size. I know this mid-size range of > 50mb but < 2 GB isn't huge, so may not be particularly useful for most people, but it is an easy way to avoid cluttering up a git repo.
Of course ideally the data would eventually be uploaded to a DOI-providing repository and contentURL
would be amended to that anyway.
from dataspice.
Whoa, piggyback is cool. This looks like a nice way to get a file shareable fast considering the user already has a repo on GitHub. Does Zenono archive release assets like the ones piggyback
creates?
Part of me likes the idea of scoping this package to "data checked into git" but that might be just to simplify things for me rather than a user.
Stepping back, I had thought about how we'd support users making use of non-local files in their scripts. There's nothing in our metadata generation process that prohibits a user from filling in more rows in the access.csv
but it'd be nice to automate this. Can you think of any other patterns we could leverage to automatically fill in rows in access.csv
(and attributes.csv
too for that matter) when the user wants to document more than files checked in under ./data
?
from dataspice.
Related Issues (20)
- Feature request: Add file to attributes
- Migrate from spread to pivot_wider
- Address width and scrolling in Shiny apps HOT 1
- Make use of rhandsontable's read only features
- Add ropensci onboarding reviewers in package acknowledgement section
- Complete final tasks from onboarding
- build_site() generates a docs folder even if user has set custom out_path HOT 4
- Using dataspice for multiple datasets
- Display citation and author fields in the html page
- Bug: Cannot use the biblio.csv metadata file due to keywords issue HOT 3
- Document eml_spice functions
- Do an editing pass of shiny apps
- Create 1.0 release HOT 1
- Fix CI HOT 1
- Fix CRAN issues HOT 2
- Go through ropensci onboarding
- Switch default branch to main HOT 1
- Add Test and covr workflows HOT 1
- Session_Info generator HOT 4
- Adding a DOI
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dataspice.