GithubHelp home page GithubHelp logo

Comments (4)

BlinkDL avatar BlinkDL commented on June 6, 2024

deepspeed==0.7.0 pytorch-lightning==1.9.5 torch 1.13.1+cu117

from rwkv-lm.

fuxuelinwudi avatar fuxuelinwudi commented on June 6, 2024

RuntimeError: The following operation failed in the TorchScript interpreter.
Traceback of TorchScript (most recent call last):
File "/data1/fxl/snn_llm/RWKV-LM-main/RWKV-v4/src/model_origin.py", line 227, in jit_func

    # Mix x with the previous timestep to produce xk, xv, xr
    xx = self.time_shift(x)
         ~~~~~~~~~~~~~~~ <--- HERE
    xk = x * self.time_mix_k + xx * (1 - self.time_mix_k)
    xv = x * self.time_mix_v + xx * (1 - self.time_mix_v)

File "/home/ubuntu/miniconda3/envs/cqw/lib/python3.9/site-packages/torch/nn/modules/padding.py", line 25, in forward
def forward(self, input: Tensor) -> Tensor:
return F.pad(input, self.padding, 'constant', self.value)
~~~~~ <--- HERE
RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

from rwkv-lm.

humanpp avatar humanpp commented on June 6, 2024

我试的能运行的,
pytorch直接更新到最新版
pip install --upgrade torch
pytorch-lightning==1.9.2就行
deepspeed==0.7.0如果出问题的话,也更新到最新版
pip install --upgrade deepspeed

from rwkv-lm.

Yang-125 avatar Yang-125 commented on June 6, 2024

rwkv-4 最低版本的torch有限制吗?

from rwkv-lm.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.