RVC not working about xtts-webui

[daswer123]

Guys now busy with work projects, no time to help you, as soon as I finish I will try to help you

[Jack74r]

Did you fix the RVC problem ?
For me when i select my RVC pth file and Run, no error but my CPU is 100% and my graphic card 0 , i stopped after 1 hour

[Daedalus-1337]

I have the same issue. it sits there with this 2024-05-13 11:09:40 | INFO | rvc_python.modules.vc.pipeline | Loading rmvpe model - base_models/rmvpe.pth
like its trying to load the basemodel but its failing to do so, it just pins the cpu at 100% and does nothing.
i tried the other modes like crepe and harvest but it does the same thing . i tried giving it the rmvpe.pth model and put it in xtts-webui\models but it didnt make a difference. https://github.com/Vali-98/XTTS-RVC-UI this works fine and its basicly doing the same thing but it doesn't have the same controll over the intial tts generation so I would like to get this xtts-webui to work with rvc

[deeplearner5]

I have the same issue. it sits there with this 2024-05-13 11:09:40 | INFO | rvc_python.modules.vc.pipeline | Loading rmvpe model - base_models/rmvpe.pth like its trying to load the basemodel but its failing to do so, it just pins the cpu at 100% and does nothing. i tried the other modes like crepe and harvest but it does the same thing . i tried giving it the rmvpe.pth model and put it in xtts-webui\models but it didnt make a difference. https://github.com/Vali-98/XTTS-RVC-UI this works fine and its basicly doing the same thing but it doesn't have the same controll over the intial tts generation so I would like to get this xtts-webui to work with rvc

+1 on this - came here wondering if it was an issue at my end, I'm clearly not alone.

[MrsHorrid]

i reinstalled everything on a 3,10 env and now i get this error ...

: 31, 'attn_type': '', 'pos_enc_type': 'abs', 'fp16': False}
2024-02-13 20:53:55 | INFO | rvc_python.modules.vc.pipeline | Loading rmvpe model - base_models/rmvpe.pth
C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\pipeline.py:240: RuntimeWarning: invalid value encountered in divide
weight /= weight.sum(axis=1, keepdims=True)
2024-02-13 20:53:57 | WARNING | rvc_python.modules.vc.modules | Traceback (most recent call last):
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\modules.py", line 184, in vc_single
audio_opt = self.pipeline.pipeline(
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\pipeline.py", line 415, in pipeline
self.vc(
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\pipeline.py", line 241, in vc
npy = np.sum(big_npy[ix] * np.expand_dims(weight, axis=2), axis=1)
IndexError: index -1 is out of bounds for axis 0 with size 0

Traceback (most recent call last):
File "C:\Users\shell\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\shell\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python_main.py", line 31, in
inferred_path = infer_file(
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\infer.py", line 49, in infer_file
wavfile.write(opt_path, vc.tgt_sr, wav_opt)
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\scipy\io\wavfile.py", line 771, in write
dkind = data.dtype.kind
AttributeError: 'tuple' object has no attribute 'dtype'

[MrsHorrid]

2024-02-13 21:04:14.640 | INFO | scripts.tts_funcs:local_generation:333 - Processing time: 3.44 seconds.
2024-02-13 21:04:17 | INFO | fairseq.tasks.text_to_speech | Please install tensorboardX: pip install tensorboardX
2024-02-13 21:04:18 | INFO | rvc_python.configs.config | Found GPU NVIDIA GeForce RTX 3070 Ti Laptop GPU
is_half:True, device:cuda:0
2024-02-13 21:04:18 | INFO | rvc_python.modules.vc.modules | Loading: C:\aistuffsies\try\xtts-webui\voice2voice\rvc\germanGM\germangm.pth
gin_channels: 256 self.spk_embed_dim: 109
2024-02-13 21:04:19 | INFO | fairseq.tasks.hubert_pretraining | current directory is C:\aistuffsies\try\xtts-webui
2024-02-13 21:04:19 | INFO | fairseq.tasks.hubert_pretraining | HubertPretrainingTask Config {'_name': 'hubert_pretraining', 'data': 'metadata', 'fine_tuning': False, 'labels': ['km'], 'label_dir': 'label', 'label_rate': 50.0, 'sample_rate': 16000, 'normalize': False, 'enable_padding': False, 'max_keep_size': None, 'max_sample_size': 250000, 'min_sample_size': 32000, 'single_target': False, 'random_crop': True, 'pad_audio': False}
2024-02-13 21:04:19 | INFO | fairseq.models.hubert.hubert | HubertModel Config: {'_name': 'hubert', 'label_rate': 50.0, 'extractor_mode': default, 'encoder_layers': 12, 'encoder_embed_dim': 768, 'encoder_ffn_embed_dim': 3072, 'encoder_attention_heads': 12, 'activation_fn': gelu, 'layer_type': transformer, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation_dropout': 0.0, 'encoder_layerdrop': 0.05, 'dropout_input': 0.1, 'dropout_features': 0.1, 'final_dim': 256, 'untie_final_proj': True, 'layer_norm_first': False, 'conv_feature_layers': '[(512,10,5)] + [(512,3,2)] * 4 + [(512,2,2)] * 2', 'conv_bias': False, 'logit_temp': 0.1, 'target_glu': False, 'feature_grad_mult': 0.1, 'mask_length': 10, 'mask_prob': 0.8, 'mask_selection': static, 'mask_other': 0.0, 'no_mask_overlap': False, 'mask_min_space': 1, 'mask_channel_length': 10, 'mask_channel_prob': 0.0, 'mask_channel_selection': static, 'mask_channel_other': 0.0, 'no_mask_channel_overlap': False, 'mask_channel_min_space': 1, 'conv_pos': 128, 'conv_pos_groups': 16, 'latent_temp': [2.0, 0.5, 0.999995], 'skip_masked': False, 'skip_nomask': False, 'checkpoint_activations': False, 'required_seq_len_multiple': 2, 'depthwise_conv_kernel_size': 31, 'attn_type': '', 'pos_enc_type': 'abs', 'fp16': False}
2024-02-13 21:04:20 | INFO | rvc_python.modules.vc.pipeline | Loading rmvpe model - base_models/rmvpe.pth
C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\pipeline.py:240: RuntimeWarning: invalid value encountered in divide
weight /= weight.sum(axis=1, keepdims=True)
2024-02-13 21:04:21 | WARNING | rvc_python.modules.vc.modules | Traceback (most recent call last):
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\modules.py", line 184, in vc_single
audio_opt = self.pipeline.pipeline(
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\pipeline.py", line 415, in pipeline
self.vc(
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\modules\vc\pipeline.py", line 241, in vc
npy = np.sum(big_npy[ix] * np.expand_dims(weight, axis=2), axis=1)
IndexError: index -1 is out of bounds for axis 0 with size 0

Traceback (most recent call last):
File "C:\Users\shell\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return run_code(code, main_globals, None,
File "C:\Users\shell\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python_main.py", line 31, in
inferred_path = infer_file(
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\infer.py", line 49, in infer_file
wavfile.write(opt_path, vc.tgt_sr, wav_opt)
File "C:\aistuffsies\try\xtts-webui\venv\rvc_venv\lib\site-packages\scipy\io\wavfile.py", line 771, in write
dkind = data.dtype.kind
AttributeError: 'tuple' object has no attribute 'dtype'
Traceback (most recent call last):
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\gradio\queueing.py", line 489, in call_prediction
output = await route_utils.call_process_api(
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\gradio\route_utils.py", line 232, in call_process_api
output = await app.get_blocks().process_api(
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\gradio\blocks.py", line 1561, in process_api
result = await self.call_function(
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\gradio\blocks.py", line 1179, in call_function
prediction = await anyio.to_thread.run_sync(
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\anyio_backends_asyncio.py", line 2134, in run_sync_in_worker_thread
return await future
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\anyio_backends_asyncio.py", line 851, in run
result = context.run(func, *args)
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\gradio\utils.py", line 678, in wrapper
response = f(*args, **kwargs)
File "C:\aistuffsies\try\xtts-webui\modules\text2voice\generation.py", line 319, in generate_audio
output_file = resemble_enhance_audio(
File "C:\aistuffsies\try\xtts-webui\scripts\funcs.py", line 248, in resemble_enhance_audio
dwav, orig_sr = torchaudio.load(audio_path)
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\torchaudio_backend\utils.py", line 204, in load
return backend.load(uri, frame_offset, num_frames, normalize, channels_first, format, buffer_size)
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\torchaudio_backend\soundfile.py", line 27, in load
return soundfile_backend.load(uri, frame_offset, num_frames, normalize, channels_first, format)
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\torchaudio_backend\soundfile_backend.py", line 221, in load
with soundfile.SoundFile(filepath, "r") as file:
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\soundfile.py", line 658, in init
self._file = self._open(file, mode_int, closefd)
File "C:\aistuffsies\try\xtts-webui\venv\lib\site-packages\soundfile.py", line 1216, in _open
raise LibsndfileError(err, prefix="Error opening {0!r}: ".format(self.name))
soundfile.LibsndfileError: Error opening 'C:\aistuffsies\try\xtts-webui\output\reference_germanGM_3.mp3': File does not exist or is not a regular file (possibly a pipe?).

this is the most recent error

[Someonetoldme584]

I cant event load RVC :D how did you make it ? where did you put the model i put in rvc but didnt worked

[kalikin]

I have a problem with RVC on Python 3.11. Running with 3.10 it goes away for me. Hope this helps.

[Oninaig]

Did you find a solution for this? Python 3.10 doesn't work either.

[MrsHorrid]

Did you find a solution for this? Python 3.10 doesn't work either.

Yes solution is uninstall all python versions you got then only install 3.10 then install the repo and it'll work but the train tab now doesn't work for me

[waruigi]

Since I'm using Python 3.10.6 and generating text2voice with RVC gives me a different error, figure I'd weigh in too. Cmd Log:

2024-03-11 23:44:07.284 | INFO     | scripts.tts_funcs:local_generation:355 - Processing time: 1.56 seconds.
2024-03-11 23:44:16 | INFO | fairseq.tasks.text_to_speech | Please install tensorboardX: pip install tensorboardX
File rmvpe.pt not found, start loading...
Traceback (most recent call last):
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 793, in urlopen
    response = self._make_request(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 491, in _make_request
    raise new_e
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 467, in _make_request
    self._validate_conn(conn)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 1099, in _validate_conn
    conn.connect()
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connection.py", line 653, in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connection.py", line 806, in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\util\ssl_.py", line 465, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\util\ssl_.py", line 509, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 513, in wrap_socket
    return self.sslsocket_class._create(
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1071, in _create
    self.do_handshake()
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1342, in do_handshake
    self._sslobj.do_handshake()
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\adapters.py", line 486, in send
    resp = conn.urlopen(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 847, in urlopen
    retries = retries.increment(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\util\retry.py", line 470, in increment
    raise reraise(type(error), error, _stacktrace)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\util\util.py", line 38, in reraise
    raise value.with_traceback(tb)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 793, in urlopen
    response = self._make_request(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 491, in _make_request
    raise new_e
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 467, in _make_request
    self._validate_conn(conn)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connectionpool.py", line 1099, in _validate_conn
    conn.connect()
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connection.py", line 653, in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\connection.py", line 806, in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\util\ssl_.py", line 465, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\urllib3\util\ssl_.py", line 509, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 513, in wrap_socket
    return self.sslsocket_class._create(
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1071, in _create
    self.do_handshake()
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1342, in do_handshake
    self._sslobj.do_handshake()
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\__main__.py", line 31, in <module>
    inferred_path = infer_file(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\infer.py", line 30, in infer_file
    download_rvc_models(lib_dir)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\rvc_python\download_model.py", line 27, in download_rvc_models
    response = requests.get(url)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\sessions.py", line 725, in send
    history = [resp for resp in gen]
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\sessions.py", line 725, in <listcomp>
    history = [resp for resp in gen]
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\sessions.py", line 266, in resolve_redirects
    resp = self.send(
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "C:\xtts-webui\venv\rvc_venv\lib\site-packages\requests\adapters.py", line 501, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))
Traceback (most recent call last):
  File "C:\xtts-webui\venv\lib\site-packages\gradio\queueing.py", line 489, in call_prediction
    output = await route_utils.call_process_api(
  File "C:\xtts-webui\venv\lib\site-packages\gradio\route_utils.py", line 232, in call_process_api
    output = await app.get_blocks().process_api(
  File "C:\xtts-webui\venv\lib\site-packages\gradio\blocks.py", line 1570, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "C:\xtts-webui\venv\lib\site-packages\gradio\blocks.py", line 1456, in postprocess_data
    outputs_cached = processing_utils.move_files_to_cache(
  File "C:\xtts-webui\venv\lib\site-packages\gradio\processing_utils.py", line 265, in move_files_to_cache
    return client_utils.traverse(data, _move_to_cache, client_utils.is_file_obj)
  File "C:\xtts-webui\venv\lib\site-packages\gradio_client\utils.py", line 919, in traverse
    return func(json_obj)
  File "C:\xtts-webui\venv\lib\site-packages\gradio\processing_utils.py", line 257, in _move_to_cache
    temp_file_path = move_resource_to_block_cache(payload.path, block)
  File "C:\xtts-webui\venv\lib\site-packages\gradio\processing_utils.py", line 234, in move_resource_to_block_cache
    return block.move_resource_to_block_cache(url_or_file_path)
  File "C:\xtts-webui\venv\lib\site-packages\gradio\blocks.py", line 258, in move_resource_to_block_cache
    temp_file_path = processing_utils.save_file_to_cache(
  File "C:\xtts-webui\venv\lib\site-packages\gradio\processing_utils.py", line 170, in save_file_to_cache
    temp_dir = hash_file(file_path)
  File "C:\xtts-webui\venv\lib\site-packages\gradio\processing_utils.py", line 102, in hash_file
    with open(file_path, "rb") as f:
FileNotFoundError: [Errno 2] No such file or directory: 'C:\\xtts-webui\\output\\reference_PatrickWarburton_12.wav'

[GamingDaveUk]

Its been sat doing something but not doing anything for about 10 minutes here... i am sure its errored as rvc is usually fast

[Appass]

Same issue for me running on python 3.10.9, v2.0.2 on xtts.

[PrometheusDante]

Same for me. It doesn't throw an error, but just computes endlessly until manually stopped.