Error when trying to quantize GGUF. about llm-course

[Samdoses]

I understand that the wrong version of several dependencies are being installed from the requirements.txt of llama.cpp. Is there any way to manually set the misbehaving dependencie's version myself in the collab code?

Thanks!

[mlabonne]

Yes, you can add a line after the installation of the requirements: !pip install your-library

…

On Sat, Apr 20, 2024, 17:39 Samdoses ***@***.***> wrote: I understand that the wrong version of several dependancies are being installed from the requirements.txt of llama.cpp. Is there any way to manually set the dependancy version myself in the collab code? — Reply to this email directly, view it on GitHub <#64 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ATL5EGS4AOHWEOI37WJH6BLY6KK33AVCNFSM6AAAAABGQTW3QCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRXG4ZDIOBQG4> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[Samdoses]

I tried installing the dependencies, but they seem to be uninstalled immediately. Is there a way to prevent this and force the code to use the updated versions instead of those specified in the requirements file?

Attempting uninstall: protobuf
Found existing installation: protobuf 3.20.3
Uninstalling protobuf-3.20.3:
Successfully uninstalled protobuf-3.20.3
Attempting uninstall: numpy
Found existing installation: numpy 1.25.2
Uninstalling numpy-1.25.2:
Successfully uninstalled numpy-1.25.2
Attempting uninstall: torch
Found existing installation: torch 2.2.1+cu121
Uninstalling torch-2.2.1+cu121:
Successfully uninstalled torch-2.2.1+cu121

[jazelly]

Hi, have you considered using venv or conda? Looks like you got some existing deps that are unhappy with the requirements.txt that you are trying to install