Comments (5)
yzh119
commented on May 17, 2024
We have some preliminary support for MOSS on the main branch, and you can compile and run them manually (by specifying --model moss-moon-003-sft. Currently, they are still using default schedules (that said, very slow). I'll tune the kernel performance by the end of this week, and we will make them available in the next release.
@LeshengJin is working on ChatGLM support.
from mlc-llm.
lucasjinreal
commented on May 17, 2024
@yzh119 thanks, hoping for it. Does there any estimates on when will next release happen?
from mlc-llm.
yzh119
commented on May 17, 2024
We can make a release as soon as we finish tuning the Dolly and MOSS performance.
from mlc-llm.
colakang
commented on May 17, 2024
how about Chinese-Alpaca-Plus-7B?
is it possible run on mlc-llm?
from mlc-llm.
jiacheo
commented on May 17, 2024
We have some preliminary support for MOSS on the main branch, and you can compile and run them manually (by specifying
--model moss-moon-003-sft. Currently, they are still using default schedules (that said, very slow). I'll tune the kernel performance by the end of this week, and we will make them available in the next release.@LeshengJin is working on ChatGLM support.
Hi @LeshengJin, how was the progress going on ChatGLM?
from mlc-llm.
Related Issues (20)
- Prebuilt StableLM 1.6B model compilation not working HOT 4
- [Model Request] can we get Aryanne/Calypso-3B-alpha-v2-gguf HOT 1
- [Bug] REST server doesn't work on V100 (SM70) - cudaErrorNoKernelImageForDevice (but chat works) HOT 16
- [Bug] mlc-llm not working, tvm check returns none HOT 24
- Android MLCChat failed ,[Bug] HOT 6
- [Bug] Compiling the MLC from source is failed HOT 2
- [Bug] Error while attempting to build PHI-3(128k) for use in MLC-LLM on the Orange Pi 5 Plus (RK3588) HOT 3
- [Bug] Support multiple "system" messages in REST API HOT 6
- [Question] Can't get going on Mac M2 Chip HOT 3
- libmodel_android.a error when build android sdk HOT 10
- [Feature Request] Medusa support HOT 6
- [Bug] mlc_llm package failed once, and i cant run it again HOT 1
- [Tracking] Sentence Embedding Model HOT 2
- [Tracking] Create a CPU Compatible PagedKVCache
- [Bug] Error on running mlc_llm package (Unknown CMake command "tvm_file_glob") HOT 3
- [Bug] InternalError: Check failed: (res == VK_SUCCESS) is false: Vulkan Error, code=-4: VK_ERROR_DEVICE_LOST HOT 4
- [Question] Parallel computations using multiple streams?
- Could not find org.apache.tvm:tvm-android:0.1.0.
- [Question] Deployment of Pruned Models
- [Question] Can not get chat CLI working, throwing error after cloning model HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mlc-llm.