Install with pip >=20 always triggers build about cmsis-pack-manager

[acabarbaye]

@juhhov Thanks for finding this out. We experience the same issue.
The implications of this problem are much wider than just the installation of this package as it makes mbed import command to fail if pip has been upgraded.
We will try to find a remedy ASAP.

[zacpod]

This is still happening for me. :(

C:\Users\zac>pip --version
pip 21.3 from c:\program files\python\lib\site-packages\pip (python 3.10)

C:\Users\zac>pip install cmsis-pack-manager
Collecting cmsis-pack-manager
  Using cached cmsis-pack-manager-0.3.0.tar.gz (42 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing wheel metadata (pyproject.toml) ... done
Collecting pyyaml>=5.1
  Using cached PyYAML-6.0-cp310-cp310-win_amd64.whl (151 kB)
Collecting milksnake>=0.1.2
  Using cached milksnake-0.1.5-py2.py3-none-any.whl (9.6 kB)
Collecting appdirs>=1.4
  Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Collecting cffi>=1.6.0
  Using cached cffi-1.15.0-cp310-cp310-win_amd64.whl (180 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Building wheels for collected packages: cmsis-pack-manager
  Building wheel for cmsis-pack-manager (pyproject.toml) ... error
  ERROR: Command errored out with exit status 1:
   command: 'c:\program files\python\python.exe' 'c:\program files\python\lib\site-packages\pip\_vendor\pep517\in_process\_in_process.py' build_wheel 'C:\Users\zac\AppData\Local\Temp\tmp58bzrrzd'
       cwd: C:\Users\zac\AppData\Local\Temp\pip-install-3w9duaxa\cmsis-pack-manager_e79c3b68937240a380554d97b3e76eff
  Complete output (11 lines):
  running bdist_wheel
  running build
  running build_py
  creating build\lib
  creating build\lib\cmsis_pack_manager
  copying cmsis_pack_manager\pack_manager.py -> build\lib\cmsis_pack_manager
  copying cmsis_pack_manager\_native.py -> build\lib\cmsis_pack_manager
  copying cmsis_pack_manager\_native__ffi.py -> build\lib\cmsis_pack_manager
  copying cmsis_pack_manager\_version.py -> build\lib\cmsis_pack_manager
  copying cmsis_pack_manager\__init__.py -> build\lib\cmsis_pack_manager
  error: [WinError 2] The system cannot find the file specified
  ----------------------------------------
  ERROR: Failed building wheel for cmsis-pack-manager
Failed to build cmsis-pack-manager
ERROR: Could not build wheels for cmsis-pack-manager, which is required to install pyproject.toml-based projects

C:\Users\zac>

[flit]

@zacpod Are you using Python 3.10? I was able to reproduce the issue with 3.10. It looks like this was just fixed by pip 21.3. (Literally as I was testing, one second it was building CPM with pip 21.2.3, then at the end of that install it announced that pip 21.3 was available. 😄 )

If the new pip doesn't work for you, as a workaround you can install Rust (see https://rustup.rs/) and it should build.

[acabarbaye]

This may actually be caused by this issue: pypa/pip#7629

[juhhov]

Pip 20.0.2 fixes this.

[marcel-bluestone]

I still do experience an error with pip 20.3.4

Collecting cmsis-pack-manager<0.3.0,>=0.2.3
Using cached cmsis-pack-manager-0.2.10.tar.gz (45 kB)
ERROR: Command errored out with exit status 1:
command: /home/marcel/.pyenv/versions/2.7.18/bin/python2.7 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-t6pg_T/cmsis-pack-manager/setup.py'"'"'; file='"'"'/tmp/pip-install-t6pg_T/cmsis-pack-manager/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-y36jvN
cwd: /tmp/pip-install-t6pg_T/cmsis-pack-manager/
Complete output (60 lines):
/tmp/easy_install-TGE31H/setuptools_scm-6.0.1/src
<pkg_resources.WorkingSet object at 0xffffa6fc9250>
Traceback (most recent call last):
File "", line 1, in
File "/tmp/pip-install-t6pg_T/cmsis-pack-manager/setup.py", line 73, in
test_suite="tests"
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/init.py", line 144, in setup
_install_setup_requires(attrs)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/init.py", line 139, in _install_setup_requires
dist.fetch_build_eggs(dist.setup_requires)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/dist.py", line 719, in fetch_build_eggs
replace_conflicting=True,
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/pkg_resources/init.py", line 782, in resolve
replace_conflicting=replace_conflicting
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/pkg_resources/init.py", line 1065, in best_match
return self.obtain(req, installer)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/pkg_resources/init.py", line 1077, in obtain
return installer(requirement)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/dist.py", line 786, in fetch_build_egg
return cmd.easy_install(req)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 679, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 705, in install_item
dists = self.install_eggs(spec, download, tmpdir)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 890, in install_eggs
return self.build_and_install(setup_script, setup_base)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 1158, in build_and_install
self.run_setup(setup_script, setup_base, args)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 1144, in run_setup
run_setup(setup_script, args)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 253, in run_setup
raise
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/contextlib.py", line 35, in exit
self.gen.throw(type, value, traceback)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 195, in setup_context
yield
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/contextlib.py", line 35, in exit
self.gen.throw(type, value, traceback)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 166, in save_modules
saved_exc.resume()
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 141, in resume
six.reraise(type, exc, self._tb)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 154, in save_modules
yield saved
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 195, in setup_context
yield
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 250, in run_setup
_execfile(setup_script, ns)
File "/home/marcel/.pyenv/versions/2.7.18/lib/python2.7/site-packages/setuptools/sandbox.py", line 45, in _execfile
exec(code, globals, locals)
File "/tmp/easy_install-TGE31H/setuptools_scm-6.0.1/setup.py", line 52, in
with open("test_requirements.txt") as testreq:
File "/tmp/easy_install-TGE31H/setuptools_scm-6.0.1/setup.py", line 29, in scm_config
spec.add_cffi_module(
File "/tmp/easy_install-TGE31H/setuptools_scm-6.0.1/src/setuptools_scm/init.py", line 8, in
File "/tmp/easy_install-TGE31H/setuptools_scm-6.0.1/src/setuptools_scm/config.py", line 6, in
File "/tmp/easy_install-TGE31H/setuptools_scm-6.0.1/src/setuptools_scm/utils.py", line 41
print(*k)
^
SyntaxError: invalid syntax
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

[marcel-bluestone]

downgrading to pip 20.0.2 did not help unfortunately

[flit]

@marcel-bluestone It looks like you are using Python 2, which is not supported by cmsis-pack-manager any more. (I'm surprised pip even tried to install that version of setuptools_scm, which also does not support Python 2.)

[zacpod]

@flit Thanks - I am on Pip 21.3, but still wasn't working.
But installing Rust worked a treat.
Appreciate the quick response. :)

[flit]

Ok, thanks for the update! Not sure what the problem is then, we'll have to investigate. I'll create a new issue to track it, since it seems to be a different cause.

[zacpod]

@flit Let me know if I can help. I'm in the process of getting my Nucleo-H743ZI2 up and running with mbed, and so far it's been fairly easy - but pyocd doesn't work yet in Window or Linux. I'm sure it's mostly pebcak as I'm very new to all this, but if I can help test or shoot logs over to you I'll be more than happy to do so.

[flit]

@zacpod Really sorry, there are known issues with the H743 in pyocd. 😓 I'm working on a general fix for these kinds of issues by supporting CMSIS Pack debug sequences. You can try out this work on my feature/debug_sequences branch. The main pyocd issue is pyocd/pyOCD#1148. We can also talk on Slack if you like (link to join).

[flit]

Fyi, the issue with Python 3.10 is simple: we didn't release wheels for Python 3.10 since it wasn't final. Working on getting a wheel out. 😄

[zacpod]

@flit Great, I'll check out that branch - thanks!

[flit]

@zacpod Fyi, CPM v0.4.0 includes wheels for Python 3.10. (And pyocd requires CPM 0.4.0.)