Can I use it in Turkish? about whisper-diarization

[MahmoudAshraf97]

It now supports multi languages including Turkish, please reinstall all dependencies and download the updated code

[MahmoudAshraf97]

Hello, I'm updating it to enable several other languages, stay tuned.

[MahmoudAshraf97]

@hanweinjq I just commited a fix to support windows, please try and let me know if the error still happens

@trappedinspacetime
you need to have an Nvidia GPU to use NeMo library, try colab instead of your local machine

[trappedinspacetime]

Thank you for adding Turkish too. Unfortunately "https://download.pytorch.org/whl/cu116/torch-1.13.1%2Bcu116-cp310-cp310-linux_x86_64.whl" exits during installation due to insufficient memory. I have Lenovo IdeaPad 3 15ALC6 with ryzen 5500u, 8gb of ram and no external gpu.

[MahmoudAshraf97]

Since you have no external gpu, you can install the torch-cpu version but i'm not sure if nvidia nemo will work without nvidia gpu

[trappedinspacetime]

[MahmoudAshraf97]

please make sure that NeMo is installed, you can use colab, the gpu provided can run it with no problems

[trappedinspacetime]

I issued the following command :

    pip install nemo

within virtual environment but I get the same error above.

[MahmoudAshraf97]

the correct is
pip install git+https://github.com/NVIDIA/[email protected]#egg=nemo_toolkit[asr]

[hanweinjq]

[trappedinspacetime]

I did:

   pip install git+https://github.com/NVIDIA/[email protected]#egg=nemo_toolkit[asr]

then

    python diarize.py -a taken_clip.wav
    [NeMo W 2023-02-08 16:32:30 optimizers:55] Apex was not found. Using the lamb or fused_adam optimizer will error out.
    [NeMo W 2023-02-08 16:32:31 nemo_logging:349] /home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/jit/annotations.py:309: UserWarning: TorchScript will treat type annotations of Tensor dtype-specific subtypes as if they are normal Tensors. dtype constraints are not enforced in compilation either.
          warnings.warn("TorchScript will treat type annotations of Tensor "
        
    2023-02-08 16:32:31.985818: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
    To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
    2023-02-08 16:32:32.333968: E tensorflow/stream_executor/cuda/cuda_blas.cc:2981] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
    2023-02-08 16:32:33.213139: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/****/rust/lib:
    2023-02-08 16:32:33.213248: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/****/rust/lib:
    2023-02-08 16:32:33.213257: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
    Selected model is a bag of 4 models. You will see that many progress bars per track.
    Separated tracks will be stored in /home/****/Desktop/2023-02/whisper-diarization/temp_outputs/htdemucs_ft
    Separating track taken_clip.wav
      0%|                                                                            50%|█████████████████████████████████████                                     |100%|██████████████████████████████████████████████████████████████████████████|100%|██████████████████████████████████████████████████████████████████████████| 11.7/11.7 [00:08<00:00,  1.32seconds/s]
      0%|                                                                            50%|█████████████████████████████████████                                     |100%|██████████████████████████████████████████████████████████████████████████|100%|██████████████████████████████████████████████████████████████████████████| 11.7/11.7 [00:08<00:00,  1.32seconds/s]
      0%|                                                                            50%|█████████████████████████████████████                                     |100%|██████████████████████████████████████████████████████████████████████████|100%|██████████████████████████████████████████████████████████████████████████| 11.7/11.7 [00:08<00:00,  1.34seconds/s]
      0%|                                                                            50%|█████████████████████████████████████                                     |100%|██████████████████████████████████████████████████████████████████████████|100%|██████████████████████████████████████████████████████████████████████████| 11.7/11.7 [00:09<00:00,  1.27seconds/s]
    [NeMo W 2023-02-08 16:33:22 nemo_logging:349] /home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/whisper/transcribe.py:79: UserWarning: FP16 is not supported on CPU; using FP32 instead
          warnings.warn("FP16 is not supported on CPU; using FP32 instead")
        
    100%|█████████████████████████████████████| 694/694 [00:17<00:00, 40.79frames/s]
    Traceback (most recent call last):
      File "/home/****/Desktop/2023-02/whisper-diarization/diarize.py", line 102, in <module>
        alignment_model, metadata = whisperx.load_align_model(
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/whisperx/transcribe.py", line 601, in load_align_model
        align_model = bundle.get_model().to(device)
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/nn/modules/module.py", line 989, in to
        return self._apply(convert)
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/nn/modules/module.py", line 641, in _apply
        module._apply(fn)
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/nn/modules/module.py", line 641, in _apply
        module._apply(fn)
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/nn/modules/module.py", line 641, in _apply
        module._apply(fn)
      [Previous line repeated 1 more time]
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/nn/modules/module.py", line 664, in _apply
        param_applied = fn(param)
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/nn/modules/module.py", line 987, in convert
        return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
      File "/home/****/.pyenv/versions/3.10.7/lib/python3.10/site-packages/torch/cuda/__init__.py", line 229, in _lazy_init
        torch._C._cuda_init()
    RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx