GithubHelp home page GithubHelp logo

modin-feedstock's People

Stargazers

avatar

Watchers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Forkers

regro-cf-autotick-bot devin-petersohn aregm vnlitvinov h-vetinari anacondarecipes maksimbo1 conda-forge-linter yarshev garra1980 mvashishtha anmyachev jrsacher rehansd conda-forge-admin isuruf

modin-feedstock's Issues

Add support for osx_arm64

Comment:

I added modin to the automatic osx_arm64 migration list, but it looks like the changes are held up as "awaiting parents". I'm guessing this is due to ray not being available for OSX?

If that's what's holding up the build, can support for osx_arm64 be added manually? I know the current osx_64 build skips the modin-ray portion, so I'm assuming the osx_arm64 build would as well.

Switch on ray support

@devin-petersohn

You might have seen that conda-forge/staged-recipes#11160 was recently merged. The feedstock for ray-packages still needs to upgrade to python 3.9 (and osx is not yet supported), but I believe we should finally be able to switch on ray-support for modin also in conda-forge as soon as the 3.9-migrator has come past.

Thoughts?

Enable python 3.10 for modin-ray on windows

Solution to issue cannot be found in the documentation.

  • I checked the documentation.

Issue

Currently there is an exception when modin-ray is used on Windows along with python 3.10. Apparently he reason is lack of 3.10 support in ray 2.0 which is said to be in full strength in 2.2

Installed packages

ray 2.0
python 3.10

Environment info

n/a

python 3.8 builds removal

Comment:

We have fake builds for python 3.8, which do not actually build valid packages. Modin supports python >=3.9 so there is no need for these builds. @h-vetinari, I was wondering if you could give some insight on how we could remove these builds?

The paging file is too small for this operation to complete

Comment:

We have a simple test in meta.yml for running Modin on Ray.

python -c "import modin.pandas as pd, modin.config as cfg; cfg.Engine.put('Ray'); df = pd.DataFrame([])"

While it works on Linux, it raises the error on Windows in CI.

OSError: [WinError 1455] The paging file is too small for this operation to complete

Example: https://dev.azure.com/conda-forge/feedstock-builds/_build/results?buildId=859318&view=logs&j=171a126d-c574-5c8c-1269-ff3b989e923d&t=623c2ba8-c4f1-582d-6c78-1c7699e2e0a2&l=3403

conda installs RC version without explicit selection

Solution to issue cannot be found in the documentation.

  • I checked the documentation.

Issue

I would expect conda install -c conda-forge modin-all to install the latest stable release, not a release candidate.
Currently, this however resolves to 0.23.0rc0 instead of 0.22.2.

Installed packages

modin-all                 0.23.0rc0       py310hff52083_0    conda-forge
modin-core                0.23.0rc0       py310hff52083_0    conda-forge
modin-dask                0.23.0rc0       py310hff52083_0    conda-forge
modin-hdk                 0.23.0rc0       py310hff52083_0    conda-forge
modin-ray                 0.23.0rc0       py310hff52083_0    conda-forge
modin-unidist             0.23.0rc0       py310hff52083_0    conda-forge

Environment info

active environment : modechoice
    active env location : /home/jmuires/anaconda3/envs/modechoice
            shell level : 2
       user config file : /home/jmuires/.condarc
 populated config files : /home/jmuires/.condarc
          conda version : 23.3.1
    conda-build version : 3.24.0
         python version : 3.8.16.final.0
       virtual packages : __archspec=1=x86_64
                          __cuda=11.6=0
                          __glibc=2.31=0
                          __linux=5.15.0=0
                          __unix=0=0
       base environment : /home/jmuires/anaconda3  (writable)
      conda av data dir : /home/jmuires/anaconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/jmuires/anaconda3/pkgs
                          /home/jmuires/.conda/pkgs
       envs directories : /home/jmuires/anaconda3/envs
                          /home/jmuires/.conda/envs
               platform : linux-64
             user-agent : conda/23.3.1 requests/2.29.0 CPython/3.8.16 Linux/5.15.0-69-generic ubuntu/20.04.6 glibc/2.31 solver/libmamba conda-libmamba-solver/23.3.0 libmambapy/1.4.1
                UID:GID : 1003:1004
             netrc file : None
           offline mode : False

`conda install -c conda-forge modin-all` installs 0.20.1, which is not latest

Solution to issue cannot be found in the documentation.

  • I checked the documentation.

Issue

We have modin=0.23.0 released, but conda installs 0.20.1.

conda create -n modin-test python=3.8
conda activate modin-test
conda install -c conda-forge modin-all

Installed packages

packages in environment at $CONDA_PREFIX/envs/modin-test:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
abseil-cpp 20211102.0 h27087fc_1 conda-forge
aiohttp 3.8.1 py38h0a891b7_1 conda-forge
aiohttp-cors 0.7.0 py_0 conda-forge
aiosignal 1.3.1 pyhd8ed1ab_0 conda-forge
arrow-cpp 11.0.0 h374c478_1
async-timeout 4.0.2 pyhd8ed1ab_0 conda-forge
attrs 23.1.0 pyh71513ae_1 conda-forge
aws-c-common 0.6.8 h5eee18b_1
aws-c-event-stream 0.1.6 h6a678d5_6
aws-checksums 0.1.11 h5eee18b_2
aws-sdk-cpp 1.8.185 h721c034_1
backports 1.0 pyhd8ed1ab_3 conda-forge
backports.functools_lru_cache 1.6.5 pyhd8ed1ab_0 conda-forge
blas 1.0 mkl
blessed 1.19.1 pyhe4f9e05_2 conda-forge
bokeh 2.4.3 pyhd8ed1ab_3 conda-forge
boost-cpp 1.73.0 h7f8727e_12
bottleneck 1.3.5 py38h7deecbd_0
brotlipy 0.7.0 py38h0a891b7_1004 conda-forge
bzip2 1.0.8 h7f98852_4 conda-forge
c-ares 1.19.0 h5eee18b_0
ca-certificates 2023.7.22 hbcca054_0 conda-forge
cachetools 5.3.1 pyhd8ed1ab_0 conda-forge
certifi 2023.7.22 pyhd8ed1ab_0 conda-forge
cffi 1.15.0 py38h3931269_0 conda-forge
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 8.0.4 py38h578d9bd_0 conda-forge
cloudpickle 2.2.1 pyhd8ed1ab_0 conda-forge
colorama 0.4.6 pyhd8ed1ab_0 conda-forge
colorful 0.5.4 pyhd8ed1ab_0 conda-forge
cryptography 41.0.2 py38h22a60cf_0
cytoolz 0.12.0 py38h5eee18b_0
dask 2023.3.2 pyhd8ed1ab_0 conda-forge
dask-core 2023.3.2 pyhd8ed1ab_0 conda-forge
dataclasses 0.8 pyhc8e2a94_3 conda-forge
distlib 0.3.7 pyhd8ed1ab_0 conda-forge
distributed 2023.3.2.1 pyhd8ed1ab_0 conda-forge
filelock 3.12.2 pyhd8ed1ab_0 conda-forge
freetype 2.10.4 h0708190_1 conda-forge
frozenlist 1.3.3 py38h5eee18b_0
fsspec 2023.6.0 pyh1a96a4e_0 conda-forge
gflags 2.2.2 he1b5a44_1004 conda-forge
giflib 5.2.1 h36c2ea0_2 conda-forge
glog 0.5.0 h48cff8f_0 conda-forge
google-api-core 2.11.1 pyhd8ed1ab_0 conda-forge
google-auth 2.22.0 pyh1a96a4e_0 conda-forge
googleapis-common-protos 1.59.1 pyhd8ed1ab_0 conda-forge
gpustat 1.1 pyhd8ed1ab_0 conda-forge
grpc-cpp 1.48.2 he1ff14a_1
grpcio 1.48.2 py38he1ff14a_1
icu 58.2 hf484d3e_1000 conda-forge
idna 3.4 pyhd8ed1ab_0 conda-forge
importlib-metadata 6.8.0 pyha770c72_0 conda-forge
importlib_metadata 6.8.0 hd8ed1ab_0 conda-forge
importlib_resources 6.0.0 pyhd8ed1ab_1 conda-forge
intel-openmp 2023.1.0 hdb19cb5_46305
jinja2 3.1.2 pyhd8ed1ab_1 conda-forge
jpeg 9e h166bdaf_1 conda-forge
jsonschema 4.17.3 pyhd8ed1ab_0 conda-forge
krb5 1.20.1 h143b758_1
lcms2 2.12 h3be6417_0
ld_impl_linux-64 2.38 h1181459_1
lerc 3.0 h295c915_0
libboost 1.73.0 h28710b8_12
libbrotlicommon 1.0.9 h166bdaf_7 conda-forge
libbrotlidec 1.0.9 h166bdaf_7 conda-forge
libbrotlienc 1.0.9 h166bdaf_7 conda-forge
libcurl 8.1.1 h251f7ec_1
libdeflate 1.17 h5eee18b_0
libedit 3.1.20221030 h5eee18b_0
libev 4.33 h516909a_1 conda-forge
libevent 2.1.12 hdbd6064_1
libffi 3.4.4 h6a678d5_0
libgcc-ng 11.2.0 h1234567_1
libgomp 11.2.0 h1234567_1
libnghttp2 1.52.0 h2d74bed_1
libpng 1.6.39 h5eee18b_0
libprotobuf 3.20.3 he621ea3_0
libssh2 1.10.0 hdbd6064_2
libstdcxx-ng 11.2.0 h1234567_1
libthrift 0.15.0 h1795dd8_2
libtiff 4.5.0 h6a678d5_2
libunwind 1.6.2 h9c3ff4c_0 conda-forge
libwebp 1.2.4 h11a3e52_1
libwebp-base 1.2.4 h5eee18b_1
locket 1.0.0 pyhd8ed1ab_0 conda-forge
lz4 4.3.2 py38h5eee18b_0
lz4-c 1.9.4 h6a678d5_0
markupsafe 2.1.1 py38h7f8727e_0
mkl 2023.1.0 h6d00ec8_46342
mkl-service 2.4.0 py38h5eee18b_1
mkl_fft 1.3.6 py38h417a72b_1
mkl_random 1.2.2 py38h417a72b_1
modin-all 0.20.1 py38h06a4308_0
modin-core 0.20.1 py38h06a4308_0
modin-dask 0.20.1 py38h06a4308_0
modin-ray 0.20.1 py38h06a4308_0
msgpack-python 1.0.3 py38hd09550d_0
multidict 6.0.2 py38h5eee18b_0
ncurses 6.4 h6a678d5_0
numexpr 2.8.4 py38hc78ab66_1
numpy 1.24.3 py38hf6e8229_1
numpy-base 1.24.3 py38h060ed82_1
nvidia-ml-py 12.535.77 pyhd8ed1ab_0 conda-forge
opencensus 0.11.2 pyhd8ed1ab_0 conda-forge
opencensus-context 0.1.3 py38h578d9bd_1 conda-forge
openssl 3.0.9 h7f8727e_0
orc 1.7.4 hb3bc3d3_1
packaging 23.1 pyhd8ed1ab_0 conda-forge
pandas 1.5.3 py38h417a72b_0
partd 1.4.0 pyhd8ed1ab_0 conda-forge
pillow 9.4.0 py38h6a678d5_0
pip 23.2.1 py38h06a4308_0
pkgutil-resolve-name 1.3.10 pyhd8ed1ab_0 conda-forge
platformdirs 3.9.1 pyhd8ed1ab_0 conda-forge
prometheus_client 0.13.1 pyhd8ed1ab_0 conda-forge
protobuf 3.20.3 py38h6a678d5_0
psutil 5.9.0 py38h5eee18b_0
py-spy 0.3.14 h52d8a92_0
pyarrow 11.0.0 py38h992f0b0_0
pyasn1 0.4.8 py_0 conda-forge
pyasn1-modules 0.2.7 py_0 conda-forge
pycparser 2.21 pyhd8ed1ab_0 conda-forge
pydantic 0.18.2 py_0 conda-forge
pyopenssl 23.2.0 pyhd8ed1ab_1 conda-forge
pyrsistent 0.18.0 py38heee7806_0
pysocks 1.7.1 pyha2e5f31_6 conda-forge
python 3.8.17 h955ad1f_0
python-dateutil 2.8.2 pyhd8ed1ab_0 conda-forge
python_abi 3.8 2_cp38 conda-forge
pytz 2023.3 pyhd8ed1ab_0 conda-forge
pyu2f 0.1.5 pyhd8ed1ab_0 conda-forge
pyyaml 6.0 py38h0a891b7_4 conda-forge
ray-core 2.3.0 py38h6a678d5_1
ray-default 2.3.0 py38h06a4308_1
re2 2022.04.01 h27087fc_0 conda-forge
readline 8.2 h5eee18b_0
requests 2.31.0 pyhd8ed1ab_0 conda-forge
rsa 4.9 pyhd8ed1ab_0 conda-forge
setproctitle 1.2.2 py38h0a891b7_2 conda-forge
setuptools 68.0.0 py38h06a4308_0
six 1.16.0 pyh6c4a22f_0 conda-forge
smart_open 6.3.0 pyhd8ed1ab_1 conda-forge
snappy 1.1.9 h295c915_0
sortedcontainers 2.4.0 pyhd8ed1ab_0 conda-forge
sqlite 3.41.2 h5eee18b_0
tbb 2021.8.0 hdb19cb5_0
tblib 1.7.0 pyhd8ed1ab_0 conda-forge
tk 8.6.12 h1ccaba5_0
toolz 0.12.0 pyhd8ed1ab_0 conda-forge
tornado 6.1 py38h0a891b7_3 conda-forge
typing-extensions 4.7.1 hd8ed1ab_0 conda-forge
typing_extensions 4.7.1 pyha770c72_0 conda-forge
urllib3 1.26.15 pyhd8ed1ab_0 conda-forge
utf8proc 2.6.1 h27cfd23_0
virtualenv 20.24.2 pyhd8ed1ab_0 conda-forge
wcwidth 0.2.6 pyhd8ed1ab_0 conda-forge
wheel 0.38.4 py38h06a4308_0
xz 5.4.2 h5eee18b_0
yaml 0.2.5 h7f98852_2 conda-forge
yarl 1.7.2 py38h0a891b7_2 conda-forge
zict 3.0.0 pyhd8ed1ab_0 conda-forge
zipp 3.16.2 pyhd8ed1ab_0 conda-forge
zlib 1.2.13 h5eee18b_0
zstd 1.5.5 hc292b87_0

Environment info

 active environment : modin-test
active env location : $CONDA_PREFIX/envs/modin-test
        shell level : 1
   user config file : $HOME_PREFIX/.condarc

populated config files :
conda version : 4.12.0
conda-build version : not installed
python version : 3.9.12.final.0
virtual packages : __linux=5.10.102.1=0
__glibc=2.35=0
__unix=0=0
__archspec=1=x86_64
base environment : $CONDA_PREFIX (writable)
conda av data dir : $CONDA_PREFIXetc/conda
conda av metadata url : None
channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
https://repo.anaconda.com/pkgs/main/noarch
https://repo.anaconda.com/pkgs/r/linux-64
https://repo.anaconda.com/pkgs/r/noarch
package cache : $CONDA_PREFIX/pkgs
$HOME_PREFIX/.conda/pkgs
envs directories : $CONDA_PREFIX/envs
$HOME_PREFIX/.conda/envs
platform : linux-64
user-agent : conda/4.12.0 requests/2.27.1 CPython/3.9.12 Linux/5.10.102.1-microsoft-standard-WSL2 ubuntu/22.04.1 glibc/2.35
UID:GID : 1000:1000
netrc file : None
offline mode : False

0.17 necessary changes

Solution to issue cannot be found in the documentation.

  • I checked the documentation.

Issue

For 0.17 we should

  • restrict ray version(?)
  • for modin-hdk raise version of pyhdk (0.2) and arrow (6.0)
  • allow python 3.10 for modin-hdk

Installed packages

N/a

Environment info

N/a

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.