Comments (2)
I haven't seen this, but googling seems to suggest it's because thereโs a mismatch between the CUDA version the binary was compiled to and the CUDA version of the device. Maybe the solution is to uninstall the fftconv
extension, then make sure to reinstall it with the right CUDA version.
from h3.
Solved after I use another cluster with a newer driver.
current output of nvidia-smi
:
Every 1.0s: nvidia-smi Mon Aug 7 19:15:39 2023
Mon Aug 7 19:15:39 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.60.13 Driver Version: 525.60.13 CUDA Version: 12.0 |
|-------------------------------+----------------------+----------------------+
Previous output:
Every 1.0s: nvidia-smi Mon Aug 7 19:19:25 2023
Mon Aug 7 19:19:25 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.129.06 Driver Version: 470.129.06 CUDA Version: 11.4 |
from h3.
Related Issues (20)
- Correct method to load 2.7B? HOT 4
- Unpickling errors when loading models HOT 1
- Releasing Training and Synthetic benchmarks HOT 3
- What is fftconv_bwd doing? HOT 2
- FFT Conv on Seq > 8192? HOT 1
- inconsistent output from fftconv_func and native pytorch fft HOT 3
- Error Running `generate_text_h3.py` (`CUDA error: CUBLAS_STATUS_NOT_INITIALIZED`) HOT 3
- Having trouble for compiling fftconv HOT 9
- The motivation for not fusioning fff(k) into the kernel HOT 2
- Release of pretraining and fine tuning code HOT 5
- Error when using use_fast_fftconv option in generate_text_h3.py HOT 3
- why dividing kv_f by fft_size? HOT 2
- Question about methodology used for evaluating FlashConv against cuFFT HOT 2
- /bin/bash: line 0: cd: csrc/fused_softmax: No such file or directory
- TypeError: forward() got an unexpected keyword argument 'last_token_only' HOT 2
- Setup for repo unclear HOT 1
- use_fast_fftconv generates error HOT 2
- Full version of H3 model? HOT 4
- Trying to generate something coherent HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h3.