Comments (6)
请问cli_demo.py能正常问答吗?
from jittorllms.
还需要您提供下错误信息中这个文件的具体内容:source file location:D:\Jianan\Win\Anaconda3\envs\jittor\JittorHome.cache\jittor\jt1.3.7\cl\py3.8.16\Windows-10-10.x04\IntelRCoreTMi7x3b\default\cu11.2.67\jit\getitem__Ti_float16__IDIM_1__ODIM_1__IV0_0__IO0_0__VS0_1__JIT_1__JIT_cpu_1__index_t_int32_hash_eaf0bc6f85e36896_op.cc
from jittorllms.
不好意思,那台电脑现在不在身边,要下周二才能再拿到,拿到再回复你哈
from jittorllms.
还需要您提供下错误信息中这个文件的具体内容:
source file location:D:\Jianan\Win\Anaconda3\envs\jittor\JittorHome.cache\jittor\jt1.3.7\cl\py3.8.16\Windows-10-10.x04\IntelRCoreTMi7x3b\default\cu11.2.67\jit\getitem__Ti_float16__IDIM_1__ODIM_1__IV0_0__IO0_0__VS0_1__JIT_1__JIT_cpu_1__index_t_int32_hash_eaf0bc6f85e36896_op.cc
内容如下:
#define JIT 1
#define JIT_cpu 1
#include <cmath>
#include "var.h"
#include "executor.h"
#include "ops/getitem_op.h"
#include "ops/op_register.h"
#include "type/fp16_compute.h"
#define getitem
#define Ti float16
#define IDIM 1
#define ODIM 1
#define IV0 0
#define IO0 0
#define VS0 1
#define index_t int32
namespace jittor {
#pragma GCC diagnostic ignored "-Wunused-variable"
void GetitemOp::jit_run() {
auto in = inputs().front();
auto out = outputs().front();
if (out->num == 0) return;
if (ns.get(GetitemOp::_inplace) &&
in->allocator == out->allocator &&
in->allocation == out->allocation)
return;
index_t oshape0 = o_shape[0];
index_t ostride0 = 1;
Ti* op = out->ptr<Ti>();
Ti* ip = in->ptr<Ti>();
index_t ishape0 =
in->shape[0];
index_t istride0 = 1;
index_t vstart0 = vs.slices[0].slice.start;
index_t vstep0 = 1;
for (index_t i0=0; i0 < oshape0; i0++) {
index_t oid = 0 + i0 * ostride0;
index_t iid0 =
(i0*vstep0+vstart0);
auto iid = 0 + iid0 * istride0;
op[oid] = ip[iid];
}
}
}
from jittorllms.
应该是修改JITTOR_HOME位置了,我修改到D盘就会报这个问题,保持C盘没问题,我的32G内存,8g显存(nVidia 2080)风险狂转,根本跑不起来
from jittorllms.
应该是修改JITTOR_HOME位置了,我修改到D盘就会报这个问题,保持C盘没问题,我的32G内存,8g显存(nVidia 2080)风险狂转,根本跑不起来
对,我就是修改了JITOR_HOME,C盘空间不够啊
from jittorllms.
Related Issues (20)
- 对比llama.cpp项目 HOT 1
- windows系统下用wsl2部署该项目 HOT 1
- 在最后一步python cli_demo.py报错求助 HOT 2
- 最后在执行python cli_demo.py chatglm时报错了(哪位大佬看看呀) HOT 1
- 执行python cli_demo.py chatglm报错客户端没有所需权限
- python cli_demo.py chatglm执行之后,输入用户之后报错,没有了后续结果 HOT 2
- cli_demo.py llama2报错
- chatglm第三个checkpoint超时 HOT 2
- 使用部署命令出现“'pangualpha' 不是内部或外部命令,也不是可运行的程序”错误 HOT 2
- 0.0.0.0:8000访问不了
- WSL2 ubuntu:python api.py chatglm = > RuntimeError
- would u support CUDA Version 12.2 ?
- python3 cli_demo.py chatglm 和 python web_demo.py chatglm部署遇到问题 HOT 1
- Building wheels for collected packages: tokenizers
- 无法部署OSError: [WinError 1314] 客户端没有所需的特权。: 'C:\\Users\\Administrator\\.cache\\jittor\\jt1.3.8\\cl\\py3.10.6\\Windows-10-10.x82\\IntelRCoreTMi3x81\\default\\checkpoints\\chat-glm/pytorch_model-00005-of-00008.bin' ->
- 安装依赖出现问题
- 换源
- 运行api.py之后,随着调用次数的增加,内存也在逐渐增加,最终直接内存占满自动被杀掉 HOT 2
- 无法运行
- 支持模型微调
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jittorllms.