thmttch / chef-continuum-anaconda Goto Github PK

version 0.4.1 when using anaconda_package, node.anaconda.install_log at line 14 of providers/package.rb is causing a
"nomethoderror: undefined method or attribute install_log' onnode' error"
when running with default configuration

Support for installing anaconda 5.2.0.
In addition there is a little bug. For passing license text 1 space is not enough (it depends on the length of the license and the lenght of the terminal or pseudo terminal.
Entering a 'q' (quit pager) instead of a space is enough.

I've added a PR to make compatible with 4.4.0. It's #24

If you run include both python (the "standard" one; there might be others, but this is the only one I know of) and this cookbook, what happens is that python tries to upgrade setuptools (it appears because the version of setuptools installed by anaconda differs/is less than the latest). This will cause the chef-run to fail with an error, something like:

Recipe: python::pip                                                                                                                                                [3947/8999]
  * cookbook_file[/var/chef/cache/get-pip.py] action create (skipped due to not_if)
  * execute[install-pip] action run (skipped due to not_if)
  * python_pip[setuptools] action upgrade
================================================================================
Error executing action `upgrade` on resource 'python_pip[setuptools]'
================================================================================


Mixlib::ShellOut::ShellCommandFailed
------------------------------------
Expected process to exit with [0], but received '1'
---- Begin output of pip install  --upgrade setuptools ----
STDOUT: Downloading/unpacking setuptools from https://pypi.python.org/packages/3.4/s/setuptools/setuptools-5.7-py2.py3-none-any.whl#md5=94eedce8d9b793d4affa4a85cd45edfa
Installing collected packages: setuptools
  Found existing installation: setuptools 3.6
Cleaning up...
Cannot remove entries from nonexistent file /opt/anaconda/2.0.1/lib/python2.7/site-packages/easy-install.pth
Storing debug log for failure in /home/ubuntu/.pip/pip.log
STDERR:
---- End output of pip install  --upgrade setuptools ----
Ran pip install  --upgrade setuptools returned 1


Cookbook Trace:
---------------
/var/chef/cache/cookbooks/python/providers/pip.rb:158:in `pip_cmd'
/var/chef/cache/cookbooks/python/providers/pip.rb:139:in `install_package'
/var/chef/cache/cookbooks/python/providers/pip.rb:144:in `upgrade_package'
/var/chef/cache/cookbooks/python/providers/pip.rb:60:in `block (2 levels) in class_from_file'
/var/chef/cache/cookbooks/python/providers/pip.rb:58:in `block in class_from_file'


Resource Declaration:
---------------------
# In /var/chef/cache/cookbooks/python/recipes/pip.rb

 50: python_pip 'setuptools' do
 51:   action :upgrade
 52:   version node['python']['setuptools_version']
 53: end


Compiled Resource:
------------------
# Declared in /var/chef/cache/cookbooks/python/recipes/pip.rb:50:in `from_file'

python_pip("setuptools") do
  action [:upgrade]
  retries 0
  retry_delay 2
  cookbook_name "python"
  recipe_name "pip"
  package_name "setuptools"
  options " --upgrade"
  timeout 900
end


[2014-09-07T20:31:57+00:00] ERROR: Running exception handlers
[2014-09-07T20:31:57+00:00] ERROR: Exception handlers complete
[2014-09-07T20:31:57+00:00] FATAL: Stacktrace dumped to /var/chef/cache/chef-stacktrace.out
Chef Client failed. 4 resources updated
[2014-09-07T20:31:57+00:00] ERROR: python_pip[setuptools] (python::pip line 50) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but rec
eived '1'
---- Begin output of pip install  --upgrade setuptools ----
STDOUT: Downloading/unpacking setuptools from https://pypi.python.org/packages/3.4/s/setuptools/setuptools-5.7-py2.py3-none-any.whl#md5=94eedce8d9b793d4affa4a85cd45edfa
Installing collected packages: setuptools
  Found existing installation: setuptools 3.6
Cleaning up...
Cannot remove entries from nonexistent file /opt/anaconda/2.0.1/lib/python2.7/site-packages/easy-install.pth
Storing debug log for failure in /home/ubuntu/.pip/pip.log
STDERR:
---- End output of pip install  --upgrade setuptools ----
Ran pip install  --upgrade setuptools returned 1

For now, the best workaround is to use chef-rewind to remove that resource, but this requires the user to know to include the workaround recipe (and can break other stuff). Clearly a hack.

This is just a hypothesis; comments, feedback, logs, new/better ideas, etc are appreciated!

python_pip conflicts with anaconda, there should be a way to install non-conda packages via the anaconda pip, perhaps conda_pip?

I see the version in master is currently 0.4.5, but the last released version was 0.4.2. Is 0.4.4 considered the version people should actually use?

anaconda::default forces the latest version of miniconda is installed always, however it should allow the end user to pin the version the same as anaconda.

version = node.anaconda.version
...
installer_basename =
  if install_type == 'anaconda'
    "Anaconda#{python_version == 'python3' ? '3' : (Gem::Version.new(version) >= Gem::Version.new('4.0.0') ? '2' : '')}-#{version}-Linux-#{flavor}.sh"
  else
    Chef::Log.debug "miniconda installs ONLY have version = latest; setting it now"
    node.anaconda.version = 'latest'
    version = 'latest'
    "Miniconda#{python_version == 'python3' ? '3' : '2'}-#{version}-Linux-#{flavor}.sh"
end

If there is a reason behind this, then it should be documented for transparency.

Will this work with the current Anaconda 4.3.1?

ImportError Traceback (most recent call last)
C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py in
63 try:
---> 64 from tensorflow.python._pywrap_tensorflow_internal import *
65 # This try catch logic is because there is no bazel equivalent for py_extension.

ImportError: DLL load failed: The specified module could not be found.

During handling of the above exception, another exception occurred:

ImportError Traceback (most recent call last)
in
----> 1 import tensorflow as tf

C:\ProgramData\Anaconda3\lib\site-packages\tensorflow_init_.py in
39 import sys as _sys
40
---> 41 from tensorflow.python.tools import module_util as _module_util
42 from tensorflow.python.util.lazy_loader import LazyLoader as _LazyLoader
43

C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python_init_.py in
38 # pylint: disable=wildcard-import,g-bad-import-order,g-import-not-at-top
39
---> 40 from tensorflow.python.eager import context
41
42 # pylint: enable=wildcard-import

C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\eager\context.py in
33 from tensorflow.core.protobuf import config_pb2
34 from tensorflow.core.protobuf import rewriter_config_pb2
---> 35 from tensorflow.python import pywrap_tfe
36 from tensorflow.python import tf2
37 from tensorflow.python.client import pywrap_tf_session

C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tfe.py in
26
27 # pylint: disable=invalid-import-order,g-bad-import-order, wildcard-import, unused-import
---> 28 from tensorflow.python import pywrap_tensorflow
29 from tensorflow.python._pywrap_tfe import *

C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py in
81 for some common reasons and solutions. Include the entire stack trace
82 above this error message when asking for help.""" % traceback.format_exc()
---> 83 raise ImportError(msg)
84
85 # pylint: enable=wildcard-import,g-import-not-at-top,unused-import,line-too-long

ImportError: Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 64, in
from tensorflow.python._pywrap_tensorflow_internal import *
ImportError: DLL load failed: The specified module could not be found.

Failed to load the native TensorFlow runtime.

See https://www.tensorflow.org/install/errors

for some common reasons and solutions. Include the entire stack trace
above this error message when asking for help.

Hi-

I'd like to add a feature request - there should be a method that allows you to run conda install [[package]] and conda remove [[package]]