400 bad request about rwkv-runner

[josStorer]

那么, 先使用convert_safetensors.py转换pth模型为st格式
然后启动时, 使用 python3 ./backend-python/main.py --webgpu, 以webgpu模式启动
接着调用/switch-model, model传st文件的路径, 其他不用管

[josStorer]

是什么情况下出现的此问题, 能否提供一下控制台输出

[Eliot00]

INFO:     Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
INFO:     127.0.0.1:59950 - "GET / HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59956 - "GET /assets/index.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59962 - "GET /assets/vendor.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59964 - "GET /assets/pdfjs-dist.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59966 - "GET /assets/uuid.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59950 - "GET /assets/index.css HTTP/1.1" 200 OK
INFO:     127.0.0.1:59966 - "GET /assets/ConfigSelector.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59962 - "GET /assets/ToolTipButton.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59966 - "GET /assets/ResetConfigsButton.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59964 - "GET /assets/useFieldControlProps.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59950 - "GET /assets/Home.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59956 - "GET /assets/RunButton.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59970 - "GET /assets/Labeled.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59962 - "GET /assets/DialogButton.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59964 - "GET /assets/DialogTrigger.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59966 - "GET /assets/useFocusFinders.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59950 - "GET /assets/Settings.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59970 - "GET /assets/Text.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59956 - "GET /assets/Page.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59962 - "GET /assets/Divider.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59966 - "GET /assets/useFocusWithin.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59950 - "GET /assets/AccordionPanel.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59964 - "GET /assets/Switch.js HTTP/1.1" 200 OK
INFO:     127.0.0.1:59970 - "GET /assets/banner.jpg HTTP/1.1" 200 OK
INFO:     127.0.0.1:59956 - "GET /assets/Slider.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59970 - "GET /assets/Completion.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59950 - "GET /assets/ValuedSlider.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59962 - "GET /assets/WorkHeader.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59966 - "GET /assets/PresetsButton.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59956 - "GET /assets/Textarea.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59974 - "GET /assets/%40microsoft/fetch-event-source.js HTTP/1.1" 304 Not Modified
INFO:     127.0.0.1:59970 - "POST /v1/completions HTTP/1.1" 400 Bad Request
INFO:     127.0.0.1:33548 - "POST /v1/completions HTTP/1.1" 400 Bad Request
INFO:     127.0.0.1:58114 - "POST /v1/completions HTTP/1.1" 400 Bad Request

[Eliot00]

F12看了返回信息，“model not loaded”，这个model要怎么配置呢？

[josStorer]

网页打开 /docs 路径有API文档, 需要先调用 /switch-model 载入模型

[Eliot00]

网页打开 /docs 路径有API文档, 需要先调用 /switch-model 载入模型

发现了，首页选择器选模型没有调接口，这个功能有计划做吗？

[josStorer]

客户端有这个功能, webui是对外给普通用户访客使用的, 暴露切换模型的界面很奇怪也很危险

[Eliot00]

好的，我是AMD GPU，这个switch-model的参数要怎么填？

{
  "customCuda": false,
  "deploy": false,
  "model": "models/RWKV-4-World-3B-v1-20230619-ctx4096.pth",
  "strategy": "cuda fp16",
  "tokenizer": ""
}

[josStorer]

如果你是windows系统, 直接下载release里的exe客户端启动

[Eliot00]

我是Linux，AMD

[Eliot00]

好的，感谢