conda-forge / datacube-feedstock

A conda-smithy repository for datacube.

About datacube-feedstock

Feedstock license: BSD-3-Clause

Home: http://www.opendatacube.org

Package license: Apache-2.0

Summary: Data analysis environment for earth observation data

Development: https://github.com/opendatacube/datacube-core

Documentation: http://datacube-core.readthedocs.io

Open Data Cube Core provides an integrated gridded data analysis environment for decades of analysis ready earth observation satellite and related data from multiple satellite and other acquisition systems.

Current build status

All platforms:

Current release info

Name	Downloads	Version	Platforms

Installing datacube

Installing datacube from the conda-forge channel can be achieved by adding conda-forge to your channels with:

conda config --add channels conda-forge
conda config --set channel_priority strict

Once the conda-forge channel has been enabled, datacube can be installed with conda:

conda install datacube

or with mamba:

mamba install datacube

It is possible to list all of the versions of datacube available on your platform with conda:

conda search datacube --channel conda-forge

or with mamba:

mamba search datacube --channel conda-forge

Alternatively, mamba repoquery may provide more information:

# Search all versions available on your platform:
mamba repoquery search datacube --channel conda-forge

# List packages depending on `datacube`:
mamba repoquery whoneeds datacube --channel conda-forge

# List dependencies of `datacube`:
mamba repoquery depends datacube --channel conda-forge

About conda-forge

conda-forge is a community-led conda channel of installable packages. In order to provide high-quality builds, the process has been automated into the conda-forge GitHub organization. The conda-forge organization contains one repository for each of the installable packages. Such a repository is known as a feedstock.

A feedstock is made up of a conda recipe (the instructions on what and how to build the package) and the necessary configurations for automatic building using freely available continuous integration services. Thanks to the awesome service provided by Azure, GitHub, CircleCI, AppVeyor, Drone, and TravisCI it is possible to build and upload installable packages to the conda-forge anaconda.org channel for Linux, Windows and OSX respectively.

To manage the continuous integration and simplify feedstock maintenance conda-smithy has been developed. Using the conda-forge.yml within this repository, it is possible to re-render all of this feedstock's supporting files (e.g. the CI configuration files) with conda smithy rerender.

For more information please check the conda-forge documentation.

Terminology

feedstock - the conda recipe (raw material), supporting scripts and CI configuration.

conda-smithy - the tool which helps orchestrate the feedstock. Its primary use is in the construction of the CI .yml files and simplify the management of many feedstocks.

conda-forge - the place where the feedstock and smithy live and work to produce the finished article (built conda distributions)

Updating datacube-feedstock

If you would like to improve the datacube recipe or build a new package version, please fork this repository and submit a PR. Upon submission, your changes will be run on the appropriate platforms to give the reviewer an opportunity to confirm that the changes result in a successful build. Once merged, the recipe will be re-built and uploaded automatically to the conda-forge channel, whereupon the built conda packages will be available for everybody to install and use from the conda-forge channel. Note that all branches in the conda-forge/datacube-feedstock are immediately built and any created packages are uploaded, so PRs should be based on branches in forks and branches in the main repository should only be used to build distinct package versions.

In order to produce a uniquely identifiable distribution:

• If the version of a package is not being increased, please add or increase the build/number.
• If the version of a package is being increased, please remember to return the build/number back to 0.

Feedstock Maintainers

• @Kirill888
• @SpacemanPaul
• @andrewdhicks
• @jeremyh
• @omad
• @snowman2

datacube-feedstock's Issues

Version not showing properly via pip

$ conda list datacube
# packages in environment at /home/snowal/miniconda/envs/midas:
#
# Name                    Version                   Build  Channel
datacube                  1.8.0                      py_0    conda-forge
$ pip show datacube
Name: datacube
Version: 0.0.0
Summary: An analysis environment for satellite and other earth observation data
Home-page: https://github.com/opendatacube/datacube-core
Author: Open Data Cube
Author-email: None
License: Apache License 2.0
Location: ~/miniconda/envs/odc/lib/python3.6/site-packages
Requires: dask, python-dateutil, jsonschema, rasterio, click, cachetools, distributed, netcdf4, numpy, psycopg2, toolz, cloudpickle, shapely, pyyaml, sqlalchemy, xarray, pyproj, affine, lark-parser
Required-by: 

Add missing dependency on lark parser

Add missing dependency on lark parser, it was added in 1.7 for use by virtual products.

Command line tools don't work on Windows

Issue

Installing datacube conda packages from this feedstock don't install working executable datacube command line tools in Windows.

Reproduce

conda create -c conda-forge --name cubeenv python=3.6 datacube=1.6.2

Executables are created in the %CURRENT_ENV%\Scripts named datacube, but they are text files which look like:

#!/bin/sh
'''exec' C:/Users/u68320/AppData/Local/Continuum/miniconda3/envs/cubeenv/bin/python "$0" "$@"
' '''
# -*- coding: utf-8 -*-
import re
import sys

from datacube.scripts.cli_app import cli

if __name__ == '__main__':
    sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$', '', sys.argv[0])
    sys.exit(cli())

Potential Fix

They should be windows executables with names like datacube.exe.

I suspect that switching away from being a noarch build will fix this.

Add build for Python 3.7

Issue:

Hi folks. This feedstock doesn't seem to be compatible with python >3.6. From reading the datacube-core docs I haven't yet found a reason why this should be the case. Can we make this work for Python 3.7 and 3.8?

Here's what happens when I try to install on Python 3.7:

$ conda install datacube

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: - 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
failed                                                                                                                                     

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your CUDA driver:

  - feature:/linux-64::__cuda==10.1=0
  - feature:|@/linux-64::__cuda==10.1=0

Your installed CUDA driver is: 10.1

No idea why it would be complaining about the CUDA driver. The driver seems to be the same in by Python 3.6 env where datacube installs fine:

$ conda info
     active environment : p36
    active env location : /home/dtip/miniconda3/envs/p36
            shell level : 1
       user config file : /home/dtip/.condarc
 populated config files : /home/dtip/.condarc
          conda version : 4.8.3
    conda-build version : 3.19.1
         python version : 3.7.6.final.0
       virtual packages : __cuda=10.1
                          __glibc=2.30
       base environment : /home/dtip/miniconda3  (writable)
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/dtip/miniconda3/pkgs
                          /home/dtip/.conda/pkgs
       envs directories : /home/dtip/miniconda3/envs
                          /home/dtip/.conda/envs
               platform : linux-64
             user-agent : conda/4.8.3 requests/2.23.0 CPython/3.7.6 Linux/5.3.0-42-generic ubuntu/19.10 glibc/2.30
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False

Environment (conda list):

$ conda list
# packages in environment at /home/dtip/miniconda3/envs/p37:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       0_gnu    conda-forge
ca-certificates           2019.11.28           hecc5488_0    conda-forge
certifi                   2019.11.28       py37hc8dfbb8_1    conda-forge
ld_impl_linux-64          2.34                 h53a641e_0    conda-forge
libffi                    3.2.1             he1b5a44_1007    conda-forge
libgcc-ng                 9.2.0                h24d8f2e_2    conda-forge
libgomp                   9.2.0                h24d8f2e_2    conda-forge
libstdcxx-ng              9.2.0                hdf63c60_2    conda-forge
ncurses                   6.1               hf484d3e_1002    conda-forge
openssl                   1.1.1e               h516909a_0    conda-forge
pip                       20.0.2                     py_2    conda-forge
python                    3.7.6           h8356626_5_cpython    conda-forge
python_abi                3.7                     1_cp37m    conda-forge
readline                  8.0                  hf8c457e_0    conda-forge
setuptools                46.1.1           py37hc8dfbb8_0    conda-forge
sqlite                    3.30.1               hcee41ef_0    conda-forge
tk                        8.6.10               hed695b0_0    conda-forge
wheel                     0.34.2                     py_1    conda-forge
xz                        5.2.4             h516909a_1002    conda-forge
zlib                      1.2.11            h516909a_1006    conda-forge

Details about conda and system ( conda info ):

$ conda info
     active environment : p37
    active env location : /home/dtip/miniconda3/envs/p37
            shell level : 1
       user config file : /home/dtip/.condarc
 populated config files : /home/dtip/.condarc
          conda version : 4.8.3
    conda-build version : 3.19.1
         python version : 3.7.6.final.0
       virtual packages : __cuda=10.1
                          __glibc=2.30
       base environment : /home/dtip/miniconda3  (writable)
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/dtip/miniconda3/pkgs
                          /home/dtip/.conda/pkgs
       envs directories : /home/dtip/miniconda3/envs
                          /home/dtip/.conda/envs
               platform : linux-64
             user-agent : conda/4.8.3 requests/2.23.0 CPython/3.7.6 Linux/5.3.0-42-generic ubuntu/19.10 glibc/2.30
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False

Update maintainer list

Comment:

1. Need to add @SpacemanPaul as he is most active in datacube-core currently
2. Possibly prune out no longer active maintainers

datacube-feedstock/recipe/meta.yaml

Lines 94 to 100 in 6bb842c

	recipe-maintainers:
	- andrewdhicks
	- GypsyBojangles
	- jeremyh
	- Kirill888
	- omad
	- snowman2