Comments (4)
bỏ cuda thay bằng cpu thì k chạy đc :(
from phogpt.
Tôi cũng vậy, không dùng cpu được
from phogpt.
Hầu hết các mô hình ngôn ngữ cần chạy trên GPU bạn nha, CPU sẽ không chạy nổi đâu.
from phogpt.
Yes, you might want to use https://github.com/ggerganov/llama.cpp that supports "MPT"-type model, including PhoGPT.
from phogpt.
Related Issues (20)
- What is the data format to perform fine turning of the phoGPT model? HOT 1
- Is there a quantization version support in the future? HOT 3
- How can I get the model to run on vLLM? HOT 2
- [Question] Hardware requirements with vLLM HOT 1
- Context Window of PhoGPT ? HOT 1
- Có giới thiệu và hướng dẫn bằng Tiếng Việt không bạn ơi! HOT 1
- Redistributing the model in other format HOT 1
- 4/8-bit with bitsandbytes HOT 1
- Do you have any plan for building a bi-lingual language English - Vietnames in the future? HOT 1
- Error wrong number of tensors when serving vinai/PhoGPT-4B-Chat with llama.cpp HOT 5
- Error message: "llama.cpp error: 'done_getting_tensors: wrong number of tensors; expected 388, got 195'" HOT 8
- Evaluation lack of context HOT 3
- hardware requirements to run finetune HOT 1
- Incomplete Response from 4bit Version of PhoGPT HOT 1
- OutOfMemoryError when Fine-tuning model PhoGPT4B with llm-foundry HOT 6
- Need some information about the tokenizer
- HuggingFace tokenizer does not pad to max_length? HOT 1
- Any online demo available? HOT 1
- Could you explain what is the diference the non-instruct and instruct PhoGPT verrsion ? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from phogpt.