Comments (5)
I was able to resolve this by adding the following lines to the end of various CMakeLists:
tools/gemm_test/CMakeLists.txt
set_target_properties(gemm_fp32 PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)
set_target_properties(gemm_fp16 PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)
fastertransformer/cuda/CMakeLists.txt
set_target_properties(fastertransformer PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)
fastertransformer/tf_op/CMakeLists.txt
set_target_properties(tf_fastertransformer PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)
I found this solution here.
I'm not sure whether this is the "correct" solution to the problem, but I'm able to compile and run ./build/bin/gemm_fp16
with these changes.
from fastertransformer.
It seems that there is something wrong with your environment. Could you please check your driver first?
from fastertransformer.
It seems that there is something wrong with your environment. Could you please check your driver first?
my environment:
cmake version 3.15.0
gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)
cuda 10.0
cudnn 7
Tensorflow-gpu 1.13.1
from fastertransformer.
I also receive this error on V100. My driver version is 418.56.
from fastertransformer.
I was able to resolve this by adding the following lines to the end of various CMakeLists:
tools/gemm_test/CMakeLists.txt
set_target_properties(gemm_fp32 PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)
set_target_properties(gemm_fp16 PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)fastertransformer/cuda/CMakeLists.txt
set_target_properties(fastertransformer PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)fastertransformer/tf_op/CMakeLists.txt
set_target_properties(tf_fastertransformer PROPERTIES CUDA_RESOLVE_DEVICE_SYMBOLS ON)I found this solution here.
I'm not sure whether this is the "correct" solution to the problem, but I'm able to compile and run ./build/bin/gemm_fp16 with these changes.
It works, thanks very much!
from fastertransformer.
Related Issues (20)
- cuSPARSELt is slower? HOT 1
- Whether fastertransformer supports gpt-2 classification model, such as GPT2ForSequenceClassification?
- Supporting for expert parallelism in MoE inference
- Is llama2 70b supported? Do you know minimal configuration? HOT 1
- How to serving multi-gpu inference? HOT 1
- How to get started?
- Sparsity support
- repetition_penalty logic in FT has bug HOT 1
- can support decoder only bart? such as MBartForCausalLM
- error You need C++17 to compile PyTorch
- Does FasterTransformer support multi-stream pipeline parallelism ?
- multi_block_mode performance issue HOT 1
- Confidence is not returned in the decoding example?
- on H800 can not exec nvidia/pytorch:23.09-py3 container success
- Are `fuseQKV masked attention` and Flash Attention the same?
- what is the mean of EFF-FT?
- How to know the correspondence between versions vcr.io/nvidia/pytorch:xx.xx-py3 and pytorch?
- error: ‘CUDNN_DATA_BFLOAT16’ was not declared in this scope; did you mean ‘CUDNN_DATA_FLOAT’
- bug: memory of position_encoding_table is not malloced correctly.
- can be used in diffusion models,like sd and sdxl? how?where is the demos?tks
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fastertransformer.