Issue running LLama.Web in linux container - OSX M1 about llamasharp

[SignalRT]

If you don´t mind I would like to understand your use case.

You have a ARM Mac and want to execute a docker with linux/amd64 platform so I suppose you install docker for Mac with Apple silicon version (https://docs.docker.com/desktop/install/mac-install/), and I suppose (I never tried) that docker will require Rosetta 2 because you are not using linux/arm64.

Are you expecting to run the application in linux/amd64 in CPU only?

You are making this just as a test or you will deploy the final container in other platforms expecting to execute on GPU?

[noli44]

Hi,

Sorry that compose file is a little misleading. I was attempting to run on amd64 to see if I could isolate the issue to arm64, but found the problem regardless.

It's commented out so would be would be using the default arm64 image.

At the moment I want to be able to run locally in a container (arm64), but future state will likely be linux/amd64 on cloud infrastructure.

Thanks

[SignalRT]

I will try to run it in a container. I will give you feedback once I get some conclusions.