aaronspring / remote_climate_data

a collection of remote climate data accessed via intake cached to disk

remote_climate_data

a collection of remote climate data accessed via intake cached to disk

Usage

import intake
cat = intake.open_catalog('https://raw.githubusercontent.com/aaronspring/remote_climate_data/master/master.yaml')
cat.atmosphere.HadCRUT5.to_dask()

To explore the whole catalog, you can try:

cat.walk()

Goal

Make data access for climate data easy:

• cacheable data
• documentation attached in metadata
• shareable catalogs
• quick vizualisations

Contribute and extend

• PRs for new remote climate datasets or useful geoshapes are very welcome

Relies on

• intake for catalogs and csv and zarr
• fsspec for caching
• intake_xarray for:
  • nc using netcdf4 [example]
  • tif using rioxarray [example]
  • grib using cfgrib [example missing]
• intake_thredds for using intake_xarray via THREDDS [example]
• intake_excel for Excel xls and xlsx [example]
• intake_geopandas for shapefiles shp [example], GeoJSON geo.json [example], GeoParquet parquet, PostGIS databases, Spatialite databases
• regionmask for aggregating over geoshapes
• hvplot for plotting [example]

Similar projects

• Pangeo's cloud data catalogs for multi GB and TB datasets: https://github.com/pangeo-data/pangeo-datastore