spaceml-org / gibs-downloader Goto Github PK

Either package entire tool as a Conda package, or create a requirements.py or requirements.sh that checks for conda or miniconda and installs gdal and all other dependencies in one go

Some people might be interested in downloading big images mostly instead of the most detailed. Could we allow them to set the resolution.

GHSA-95q3-8gr9-gm8w

A basic autoencoder example to show how to use TF Records plus GPU augmentations.

Give link in the description paragraph https://github.com/spaceml-org/NASA-GIBS-Downloader#nasa-gibs-downloader

1. In the question "I want to download imagery of the entire Earth. What do I need to know?" worth mentioning the size of pixels for entire earth. and how long should one expect it would take for tiling it.
2. Give a FAQ question on how many tiles would be generated based on a particular tile resolution. Example formula - https://docs.google.com/spreadsheets/d/1wFwk9MnAQOMlmMvZudQOzyYTlYTuvmTH7s2GKvxnDP8/edit?usp=sharing
3. Give a FAQ question on what happens if the tile is slightly over the edges of the image, how are these edge cases handled. Is it generated or ignored?

Content would be loaded from README and embedded code but would be structured in documentation format.

Create docstrings info for each function in https://github.com/spaceml-org/NASA-GIBS-Downloader/blob/main/GIBSDownloader/gibs_downloader.py so that sphinx can automatically compile them into the documentation

Resources: https://www.docslikecode.com/articles/github-pages-python-sphinx/ and https://pages.github.com/

How can a new contributor help or get started?
Instructions for submitting PR.

Example: https://github.com/PracticalDL/Practical-Deep-Learning-Book#bug-reporting

should be added under https://github.com/spaceml-org/NASA-GIBS-Downloader#nasa-gibs-downloader

Example: https://man7.org/linux/man-pages/man1/cd.1p.html

Add under https://github.com/spaceml-org/NASA-GIBS-Downloader#nasa-gibs-downloader

For all commands that depend on the original image being downloaded properly (e.g. tiling, writing to tfrecords, generating video), implement some sort of check that the original images we are using are what we expect them to be. Things to consider:

• check that image size is as expected
• check that pixel values are as expected (not completely missing from image)

Alternatively, instead of implementing the check while tilling or writing to tfrecords AFTER the images are downloaded, catch any errors from the call to gdal_translate which may signal that the data being downloaded is faulty WHILE it is downloading.

Unexpected errors/warnings that have sometimes occurred in downloading:

• ERROR 1: GDALWMS: Unable to download block 96, 0. URL: Failed to connect to gibs.earthdata.nasa.gov port 443: Timed out. HTTP status code: 0, error: Failed to connect to gibs.earthdata.nasa.gov port 443: Timed out.
• Warning 1: libjpeg: Premature end of JPEG file (this warning can be turned as an error by setting GDAL_ERROR_ON_LIBJPEG_WARNING to TRUE)