[BUG] "IndexError: list index out of range" During pip install about autogptq

[fxmarty]

@GuardMoony @aadityabhatia Qigen build is disabled by default now, so you should not face this issue anymore. Feel free to open a PR to fix qigen build, but I don't think many people are using it.

[aadityabhatia]

I believe so. I am using pip and the files are being downloaded from files.pythonhosted.org. Here is what I get-

$ pip install -U auto-gptq                                                                                                                             
Collecting auto-gptq
  Using cached auto_gptq-0.7.1.tar.gz (126 kB)
  Preparing metadata (setup.py) ... done
Discarding https://files.pythonhosted.org/packages/90/e5/b22697903982284fe284568fb2663a2196694a8eee637f5cf4ccfe435a38/auto_gptq-0.7.1.tar.gz (from https://pypi.org/simple/auto-gptq/) (requires-python:>=3.8.0): Requested auto-gptq from https://files.pythonhosted.org/packages/90/e5/b22697903982284fe284568fb2663a2196694a8eee637f5cf4ccfe435a38/auto_gptq-0.7.1.tar.gz has inconsistent version: expected '0.7.1', but metadata has '0.7.1+cu122'
  Using cached auto_gptq-0.7.0.tar.gz (124 kB)
  Preparing metadata (setup.py) ... done
Discarding https://files.pythonhosted.org/packages/34/71/c3e73cf17681f6ff4754ef8f4cb8b67af3def230fc8711eac1250bbd78d5/auto_gptq-0.7.0.tar.gz (from https://pypi.org/simple/auto-gptq/) (requires-python:>=3.8.0): Requested auto-gptq from https://files.pythonhosted.org/packages/34/71/c3e73cf17681f6ff4754ef8f4cb8b67af3def230fc8711eac1250bbd78d5/auto_gptq-0.7.0.tar.gz has inconsistent version: expected '0.7.0', but metadata has '0.7.0+cu122'
  Downloading auto_gptq-0.6.0.tar.gz (120 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.0/121.0 kB 1.7 MB/s eta 0:00:00

[aadityabhatia]

Same issue here. Why not just use multiprocessing.cpu_count() or os.cpu_count() to count the CPUs?

[aadityabhatia]

Thank you! Was able to install directly from github: pip install git+https://github.com/AutoGPTQ/AutoGPTQ

Part of the issue was also an issue with versioning: auto_gptq-0.7.0.tar.gz has inconsistent version: expected '0.7.0', but metadata has '0.7.0+cu122, which caused pip to use older versions.

Collecting auto-gptq                    
  Using cached auto_gptq-0.7.0.tar.gz (124 kB)                                                                                                                                                  Preparing metadata (setup.py) ... done                                                                                                                                                      Discarding https://files.pythonhosted.org/packages/34/71/c3e73cf17681f6ff4754ef8f4cb8b67af3def230fc8711eac1250bbd78d5/auto_gptq-0.7.0.tar.gz (from https://pypi.org/simple/auto-gptq/) (requires-python:>=3.8.0): Requested auto-gptq from https://files.pythonhosted.org/packages/34/71/c3e73cf17681f6ff4754ef8f4cb8b67af3def230fc8711eac1250bbd78d5/auto_gptq-0.7.0.tar.gz has inconsistent version: expected '0.7.0', but metadata has '0.7.0+cu122'
  Using cached auto_gptq-0.6.0.tar.gz (120 kB)
  Preparing metadata (setup.py) ... done
Discarding https://files.pythonhosted.org/packages/49/af/02b66e55dfd9aeb0ece923843043724ed7432ec0c649ea0f3b9fa1dd90c6/auto_gptq-0.6.0.tar.gz (from https://pypi.org/simple/auto-gptq/) (requires-python:>=3.8.0): Requested auto-gptq from https://files.pythonhosted.org/packages/49/af/02b66e55dfd9aeb0ece923843043724ed7432ec0c649ea0f3b9fa1dd90c6/auto_gptq-0.6.0.tar.gz has inconsistent version: expected '0.6.0', but metadata has '0.6.0+cu122'
  Using cached auto_gptq-0.5.1.tar.gz (112 kB)

[GuardMoony]

Verified. It's working correctly now.

[fxmarty]

@aadityabhatia

Part of the issue was also an issue with versioning: auto_gptq-0.7.0.tar.gz has inconsistent version: expected '0.7.0', but metadata has '0.7.0+cu122, which caused pip to use older versions.

Is this on pypi?