生成数字人的时候没有用到GPU about paddlebobo

[1092892791]

需要加什么命令

[JiadiLee]

我也遇到了同样的问题，请问你问题解决了吗？

[1092892791]

我也遇到了同样的问题，请问你问题解决了吗？

飞桨有GPU版本 但是我安装后启动不了 可能是我的显卡不行

[lilongwei5054]

@JiadiLee @1092892791 怎么看出来有没有用到GPU啊，我感觉有点慢，生成数字人用了快5、6分钟的样子,后面生成视频非常快，基本上是秒生成。

(base) root@ThinkStation-K-C2:/home/pypro/paddlebobo/PaddleBoBo# python create_virtual_human.py --config default.yaml
[05/27 17:04:22] ppgan INFO: Downloading GPEN-512.pdparams from https://paddlegan.bj.bcebos.com/models/GPEN-512.pdparams to /root/.cache/ppgan/GPEN-512.pdparams
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 277380/277380 [00:32<00:00, 8538.66it/s]
W0527 17:04:56.054323 142233 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 11.4, Runtime API Version: 10.2
W0527 17:04:56.082055 142233 gpu_resources.cc:91] device: 0, cuDNN Version: 8.4.
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_0. generator.noises.noise_0 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_1. generator.noises.noise_1 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_2. generator.noises.noise_2 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_3. generator.noises.noise_3 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_4. generator.noises.noise_4 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_5. generator.noises.noise_5 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_6. generator.noises.noise_6 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_7. generator.noises.noise_7 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_8. generator.noises.noise_8 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_9. generator.noises.noise_9 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_10. generator.noises.noise_10 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_11. generator.noises.noise_11 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_12. generator.noises.noise_12 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_13. generator.noises.noise_13 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
/usr/local/software/anaconda/install/lib/python3.9/site-packages/paddle/fluid/dygraph/layers.py:1652: UserWarning: Skip loading for generator.noises.noise_14. generator.noises.noise_14 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
[05/27 17:04:56] ppgan INFO: Downloading vox-cpk-512.pdparams from https://paddlegan.bj.bcebos.com/applications/first_order_model/vox-cpk-512.pdparams to /root/.cache/ppgan/vox-cpk-512.pdparams
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 244490/244490 [00:29<00:00, 8163.83it/s]
[05/27 17:05:26] ppgan INFO: Found /root/.cache/ppgan/GPEN-512.pdparams
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 109119/109119 [00:18<00:00, 6038.36it/s]
1 persons have been detected
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 300/300 [00:32<00:00, 9.32it/s]
[2023-05-27 17:06:23,960] [ WARNING] _io.py:547 - IMAGEIO FFMPEG_WRITER WARNING: input image is not divisible by macro_block_size=16, resizing from (1476, 826) to (1488, 832) to ensure video compatibility with most codecs and players. To prevent resizing, make your input image divisible by the macro_block_size or set the macro_block_size to 1 (risking incompatibility).
[swscaler @ 0x614fbc0] Warning: data is not aligned! This can lead to a speed loss
已成功创建虚拟人，文件保存在./file/input/test.mp4
(base) root@ThinkStation-K-C2:/home/pypro/paddlebobo/Pad

[JiadiLee]

@lilongwei5054 我是在一个终端运行数字人生成，在另一个终端查看GPU和CPU的使用率，如果为了方便也可以写个脚本每隔几毫秒查看一下利用率，用nvidia-smi 也能同时查看哪些进程在使用GPU。我这边是明显看到GPU使用率特别低，但是CPU占用很高，同时生成速度很慢。因为硬件环境不同，所以我无法通过时间判断你的GPU使用是否正常。

我这边没有用到GPU是两个原因：
1.我同时安装了ppgan 和ppgan-gpu，但是环境里ppgan-gpu 的版本不对，GPU跑不起来，在生成脚本里自动选择了CPU运行
2.我把ppgan卸掉之后，只保留ppgan-gpu然后会报no gpu device类似的报错，环境里CUDA是11.1，但是ppgan-gpu我安装的版本对应11.2/11.3，会有库找不到的情况，我重新安装ppgan-gpu对应的版本后运行正常

建议根据Bobo的脚本，结合ppgan那边FOM和wav2lip 的算法文档把生成流程自己走一遍，比较容易发现问题

[TTyb]

同样遇到了这个问题，GPU没有使用，跑的是默认脚本：

python general_demo.py --human ./file/input/test.mp4 --output ../output.mp4 --text 各位开发者大家好，我是您的专属虚拟主播，很高兴能为您服务。

[sanwei111]

@lilongwei5054 我是在一个终端运行数字人生成，在另一个终端查看GPU和CPU的使用率，如果为了方便也可以写个脚本每隔几毫秒查看一下利用率，用nvidia-smi 也能同时查看哪些进程在使用GPU。我这边是明显看到GPU使用率特别低，但是CPU占用很高，同时生成速度很慢。因为硬件环境不同，所以我无法通过时间判断你的GPU使用是否正常。

我这边没有用到GPU是两个原因： 1.我同时安装了ppgan 和ppgan-gpu，但是环境里ppgan-gpu 的版本不对，GPU跑不起来，在生成脚本里自动选择了CPU运行 2.我把ppgan卸掉之后，只保留ppgan-gpu然后会报no gpu device类似的报错，环境里CUDA是11.1，但是ppgan-gpu我安装的版本对应11.2/11.3，会有库找不到的情况，我重新安装ppgan-gpu对应的版本后运行正常

建议根据Bobo的脚本，结合ppgan那边FOM和wav2lip 的算法文档把生成流程自己走一遍，比较容易发现问题

没有pgan-gpu兄弟

[JiadiLee]

没有pgan-gpu兄弟

不好意思，是 pip install paddlepaddle-gpu，我CUDA11.1 安装的2.3.2.post111

[sanwei111]

没有pgan-gpu兄弟

不好意思，是 pip install paddlepaddle-gpu，我CUDA11.1 安装的2.3.2.post111

兄弟，可以发一下版本吗，paddlespeech，paddleaudio，python版本

[JiadiLee]

兄弟，可以发一下版本吗，paddlespeech，paddleaudio，python版本

python是3.7.13，paddlespeech我是下载源码编译的，paddleaudio==1.1.0，ppgan==2.1.0，paddlepaddle-gpu==2.3.2.post111，不过我这个是在docker环境下操作的，paddle的镜像安装的是2.4.2-gpu-cuda11.2-cudnn8.2-trt8.0。

[mmhzlrj]

没有pgan-gpu兄弟

不好意思，是 pip install paddlepaddle-gpu，我CUDA11.1 安装的2.3.2.post111

兄弟，可以发一下版本吗，paddlespeech，paddleaudio，python版本

官网有配环境的教程，其实希望报错的里面把这加上就更好了 https://www.paddlepaddle.org.cn/

[mmhzlrj]

W0527 17:04:56.054323 142233 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 11.4, Runtime API Version: 10.2

如果我没理解错，这日志意味着你用了GPU来跑，我的没显示
W0527 17:04:56.054323 142233 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 11.4, Runtime API Version: 10.2

[mmhzlrj]

我用的是rtx 2060 6G显存的显卡，通过Windows任务管理器可以看到，显存没有被利用，所以确定应该没有用上显卡跑。分别尝试了只安装peddlepeddle 和 多安装了peddlepeddle-gpu 的环境下都是一样的速度。不一样的是我没有上面老哥日志里的W0527 17:04:56.054323 142233 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 11.4, Runtime API Version: 10.2 要么就是直接判断了我的显存不够大，默认走CPU，要么就是有哪个地方配置我还没改

[mmhzlrj]

我用的是rtx 2060 6G显存的显卡，通过Windows任务管理器可以看到，显存没有被利用，所以确定应该没有用上显卡跑。分别尝试了只安装peddlepeddle 和 多安装了peddlepeddle-gpu 的环境下都是一样的速度。不一样的是我没有上面老哥日志里的W0527 17:04:56.054323 142233 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 11.4, Runtime API Version: 10.2 要么就是直接判断了我的显存不够大，默认走CPU，要么就是有哪个地方配置我还没改

解决办法：
conda install paddlepaddle-gpu==2.4.1 -c https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud/Paddle/ -c conda-forge
在任务管理器里面看显存使用了4-5G，原本CPU需要2个多小时的任务现在可以缩短到2分钟以下

[mmhzlrj]

(myenv) E:\PaddleBoBo>python create_virtual_human.py --config default.yaml
[09/05 15:00:34] ppgan INFO: Found C:\Users\Admin.cache\ppgan\GPEN-512.pdparams
W0905 15:00:35.922380 8908 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.5, Driver API Version: 12.2, Runtime API Version: 11.7
W0905 15:00:35.930387 8908 gpu_resources.cc:91] device: 0, cuDNN Version: 8.4.
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_0. generator.noises.noise_0 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_1. generator.noises.noise_1 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_2. generator.noises.noise_2 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_3. generator.noises.noise_3 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_4. generator.noises.noise_4 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_5. generator.noises.noise_5 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_6. generator.noises.noise_6 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_7. generator.noises.noise_7 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_8. generator.noises.noise_8 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_9. generator.noises.noise_9 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_10. generator.noises.noise_10 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_11. generator.noises.noise_11 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_12. generator.noises.noise_12 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_13. generator.noises.noise_13 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
C:\Users\Admin\miniconda3\envs\myenv\lib\site-packages\paddle\fluid\dygraph\layers.py:1517: UserWarning: Skip loading for generator.noises.noise_14. generator.noises.noise_14 is not found in the provided dict.
warnings.warn(("Skip loading for {}. ".format(key) + str(err)))
[09/05 15:00:36] ppgan INFO: Found C:\Users\Admin.cache\ppgan\vox-cpk-512.pdparams
[09/05 15:00:36] ppgan INFO: Found C:\Users\Admin.cache\ppgan\GPEN-512.pdparams
1 persons have been detected
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 300/300 [01:50<00:00, 2.72it/s]
IMAGEIO FFMPEG_WRITER WARNING: input image is not divisible by macro_block_size=16, resizing from (358, 441) to (368, 448) to ensure video compatibility with most codecs and players. To prevent resizing, make your input image divisible by the macro_block_size or set the macro_block_size to 1 (risking incompatibility).
[swscaler @ 000001a15fee00c0] Warning: data is not aligned! This can lead to a speed loss
已成功创建虚拟人，文件保存在./file/input\test.mp4