Comments (6)
Hi @arthurwolf, it looks like you may be facing one of two issues.
-
You don't have Docker Compose installed. If that's the case then you'll first need to install it before you can run
docker compose up
. To find out if you have Docker Compose installed, rundocker compose --version
in your terminal. If a version number is returned then you have it installed. -
You have Docker Compose Standalone installed, in which case the syntax you should use is
docker-compose up
. Note the hyphen. To find out if you have Standalone installed, rundocker-compose --version
Let me know if you get it sorted!
from llama-gpt.
╭─arthur at aquarelle in ~ 23-08-24 - 18:26:48
╰─○ docker compose --version
Docker version 20.10.25, build 20.10.25-0ubuntu1~23.04.1
Looks like that worked, thanks!
╭─arthur at aquarelle in ~/dev/ai/llama-gpt on master✔ 23-08-24 - 18:27:46
╰─⠠⠵ docker-compose up on master|✔
Creating network "llama-gpt_default" with the default driver
Pulling llama-gpt-api-7b (ghcr.io/abetlen/llama-cpp-python:latest)...
latest: Pulling from abetlen/llama-cpp-python
14726c8f7834: Pull complete
7d676dc8a994: Pull complete
e9e2f08137fc: Pull complete
6cc9fece80c8: Pull complete
264b6a89a95d: Pull complete
50872ae560f9: Downloading [====> ] 12.28MB/140MB
5ab61a038675: Download complete
4f4fb700ef54: Download complete
124cd1deda15: Download complete
23e537c28460: Download complete
c904885da53b: Download complete
Might be worth some kind of docs edit? Not sure how rare my situation is.
from llama-gpt.
╭─arthur at aquarelle in ~ 23-08-24 - 18:26:48 ╰─○ docker compose --version Docker version 20.10.25, build 20.10.25-0ubuntu1~23.04.1
Looks like that worked, thanks!
╭─arthur at aquarelle in ~/dev/ai/llama-gpt on master✔ 23-08-24 - 18:27:46 ╰─⠠⠵ docker-compose up on master|✔ Creating network "llama-gpt_default" with the default driver Pulling llama-gpt-api-7b (ghcr.io/abetlen/llama-cpp-python:latest)... latest: Pulling from abetlen/llama-cpp-python 14726c8f7834: Pull complete 7d676dc8a994: Pull complete e9e2f08137fc: Pull complete 6cc9fece80c8: Pull complete 264b6a89a95d: Pull complete 50872ae560f9: Downloading [====> ] 12.28MB/140MB 5ab61a038675: Download complete 4f4fb700ef54: Download complete 124cd1deda15: Download complete 23e537c28460: Download complete c904885da53b: Download complete
Might be worth some kind of docs edit? Not sure how rare my situation is.
The expectation is that you know docker & docker compose. But a slight edit to the doc would be appreciated as pointed.
from llama-gpt.
Thanks a lot for all the help.
(I'll make a PR with the docs change)
Ok so it works now, but I have a second issue, asking here just in case it's easy, I'll make a new issue if not.
so I started with
docker-compose up
It worked.
So I wanted to try 13b next, so I did:
docker-compose down
Which worked, and then:
docker-compose -f docker-compose-13b.yml up
But this gets me:
╰─⠠⠵ docker-compose -f docker-compose-13b.yml up on master|✔
Starting llama-gpt_llama-gpt-api-13b_1 ...
Starting llama-gpt_llama-gpt-api-13b_1 ... error
ERROR: for llama-gpt_llama-gpt-api-13b_1 Cannot start service llama-gpt-api-13b: network c6ea4bb425bd91c6090bfde1ef50c974ada03f2bfba27caff216184c6684a5d1 not found
ERROR: for llama-gpt-api-13b Cannot start service llama-gpt-api-13b: network c6ea4bb425bd91c6090bfde1ef50c974ada03f2bfba27caff216184c6684a5d1 not found
ERROR: Encountered errors while bringing up the project.
Which I'm not sure what to do about...
The expectation is that you know docker & docker compose
I use docker a few dozen times a year, I've even made a few containers, but I'm not sure what's the criteria for "knowing" docker, this is my first time running into this one.
from llama-gpt.
PR created, see: https://github.com/getumbrel/llama-gpt/pull/63/files
from llama-gpt.
As I mentioned in #81, Compose V1 is officially EoL and I think a proper solution would be simply to advice users to ensure they are using Compose V2: https://docs.docker.com/compose/install/
from llama-gpt.
Related Issues (20)
- Import documents HOT 1
- [Question] Is it possible to add long term memory
- Docker compose yields `http: invalid host header` HOT 2
- Unable to build CUDA-enabled image, missing Makefile HOT 17
- Running does not work on MacOS with homebrew conda HOT 3
- nvidia-container-cli error HOT 2
- Fresh Install - API Never Starts HOT 1
- Infinite loop "No such file run.sh"
- Are there any plans for load custom models? HOT 1
- airgapped npm issues in ui container
- Only works with cuda the 7b model
- Brackets in run.sh
- Installation on windows - please elaborate more
- docker compose: Permission denied running /api/run.sh HOT 2
- CUDA Support for Kubernetes
- Errors thrown when trying to start llama-gpt api using docker-compose-gguf.yml HOT 2
- IPv6 support HOT 1
- Not enough space HOT 1
- Support Multi-part .bin files?
- Is there the ability to swap the language to answer?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-gpt.