openknowledge-archive / datapackage-to-google-spreadsheet

[EXPERIMENTAL] Import data packages (http://data.okfn.org/doc/data-package) into Google Spreadsheets

datapackage-to-google-spreadsheet

Import tabular data packages (http://data.okfn.org/doc/data-package) into Google Spreadsheets

Demo

To import a tabular data pacakage into Google Spreadsheets:

1. Go to https://docs.google.com/spreadsheet/ccc?key=0AqR8dXc6Ji4JdG15Z1BhNXpCMFBnVTY5LUpoTGNrY0E#gid=0
2. Make a copy of the sheet
3. Go to Data Packages Menu -> Import Data (on the first run, you will be asked for authorization)
4. Paste in the url: http://data.okfn.org/data/house-prices-us/datapackage.json
5. Watch the data load!

Note: You can replace the datapackage.json url with any other tabular data package link

How it works

A small script is included in the spreadsheet. This in turn uses a library (the code from this repository) that loads and processes CSV data from the data package.

Do it yourself

To use the script in your own spreadsheets:

1. In your spreadsheet open the script editor to create a new script

2. Include the library. To do this:

   1. Go to Resources => Manage Resources
   2. Use the project id: MH6zwb-fUDq8QyPrl-PbJlu_4T1jeIs
   3. Make sure that the latest version is selected
   4. More information on using libraries can be found here: https://developers.google.com/apps-script/guide_libraries#useLibrary

3. Copy and paste the following into your script and hit save:

function onOpen() {
DataPackages.onOpen();
}
function importDataPackageUi() {
DataPackages.importDataPackageUi();
}

4. Hit run
5. There is now a new Data Packages menu in your spreadsheet. Whenever you open the spreadsheet in the future it will be there.

Data Requirements

Currently, the library can cope with a single CSV file from a tabular data package. The field separator should be a comma, the text delimiter should be " and the line separator should be \n. That means we're not yet fully conformant with the specification, but this will hopefully be achieved soon via a more general API that pre-processes the data according to format and dialect.

Deploying

The contents of the file library.gs.js should replace the code here:

https://script.google.com/macros/d/1GLuZPrroyUP4WkHm4aAT4Z2QUqoL60LhEJnomYZT7nzaMDjptOneTNdJ/edit

The contents of the file linking_code.gs.js need to be placed in the spreadsheet script, and the README.md (this file) updated accordingly.

datapackage-to-google-spreadsheet's Issues

Documentation

Simple instructions on README.md is fine for now

Good test data package

• Multiple resources
• Quoted quotes/text
• Entries with new lines
• All supported data types

Publish script

To https://developers.google.com/apps-script/publishing_gallery

Support for multiple CSV files

Each CSV resource becomes a GS sheet

Data package export from Google Spreadsheet?

Is there a complementary app to this that allows the export of a data package from a Google Spreadsheet?

eg we can use Google Query language (example feed) to get a quick summary of the data types associated with a column.

google.visualization.Query.setResponse(
  {"version":"0.6", "reqId":"0", "status":"ok", "sig":"1319450576",
   "table":{
      "cols":[
        {"id":"A", "label":"Text col", "type":"string"},
        {"id":"B","label":"Currency col","type":"number","pattern":"[$£-809]#,##0.00"},
        {"id":"C","label":"Date col","type":"date","pattern":"dd/MM/yyyy"}],
      "rows":[{"c":[
        {"v":"hello"},
        {"v":10.0,"f":"£10.00"},
        {"v":new Date(2014,0,12),"f":"12/01/2014"}]}]
     }
  }
);

I'm not sure if there are Google Apps scripts calls that can return the same data?

We can also make use of metadata associated with a particular document PropertiesService.getDocumentProperties() to hold the data associated with certain of the datapackage elements.

Accept \r\n in addion to \n

This would be an easy change, but will hopefully be taken care of by the Data API (cf. frictionlessdata/frictionlessdata.io#19)

Support CSV dialects

Some of this could be taken care of by passing through parameters to the CSV reading code, but it would be better to have it normalised by the API cf. frictionlessdata/frictionlessdata.io#19

Google Spreadsheet Import

From @rgrp on April 5, 2013 19:42

• Create appscript code
  • import function
  • simple UI to provide item
• Instructions for using this in your spreadsheet
• Publish a script which uses the library to the gallery so it can be auto-installed - https://developers.google.com/apps-script/publishing_gallery

Copied from original issue: frictionlessdata/frictionlessdata.io#24