juliageo / naturalearth.jl Goto Github PK

@asinghvi17 Do you have any thoughts about how to structure this repo?

My initial commit is a rough sketch of how I imagine we can maintain this repo:

• geojson_files.jl looks up all available datasets from this github directory: link.
• create_artifacts.jl does the job of creating Artifacts.toml. I imagine we can hook that up to GitHub CI to periodically check for new datasets or updates to existing datasets.
  • note: currently, I just download from [...]/master/[...], but we should probably do this by tags or something to ensure reproducibility. Although I think Artifacts will fail if a file is updated upstream since the SHA will change... Anyways -- just some food for thought.
• The current dependencies in Project.toml are not really necessary, and, along with the aforementioned files, should be moved to some subdirectory that is tied to Github CI or tests.
• Down the road we can discuss integration with GeoMakie.

It doesn't look like there is an automated solution to get rasters in the way that we've obtained vectors, so we'd have to create a manual database of all links. Then, they are presented as zipfiles, meaning that we would have to use something like Scratch.jl and ZipFile.jl to unpack them manually and store them in a package-specific scratchspace. Assuming no name duplicates, this should also allow us to present a list of already-downloaded rasters.