TTS:调用模型出错 about sherpa-onnx

[csukuangfj]

SherpaOnnxOfflineTtsConfig config;
memset(&config, 0, sizeof(config);

Please add memset to zero initialize the struct.

Please see also

sherpa-onnx/c-api-examples/offline-tts-c-api.c

Line 145 in 35c1b4a

memset(&config, 0, sizeof(config));

from sherpa-onnx.

[kyn817046]

Thank you very much! Is there any explanation of parameters in TTS? I have read the document of this information is relatively small, do I not find the place?

[csukuangfj]

If you use the C++ binary, e.g.,

./build/bin/sherpa-onnx-offline-tts --help

you would see the help message of each member variable of the struct.

[kyn817046]

log:

D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx\c-api\c-api.cc:SherpaOnnxCreateOfflineTts:940 OfflineTtsConfig(model=OfflineTts
ModelConfig(vits=OfflineTtsVitsModelConfig(model="./vits-melo-tts-zh_en/model.onnx", lexicon="./vits-melo-tts-zh_en/lexi
con.txt", tokens="./vits-melo-tts-zh_en/tokens.txt", data_dir="", dict_dir="./vits-melo-tts-zh_en/dict", noise_scale=0.6
67, noise_scale_w=0.8, length_scale=1), num_threads=1, debug=True, provider="cpu"), rule_fsts="./vits-melo-tts-zh_en/dat
e.fst,./vits-melo-tts-zh_en/number.fst", rule_fars="", max_num_sentences=2)

D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx\csrc\offline-tts-vits-model.cc:Init:79 ---vits model---
version=2
model_type=melo-vits
jieba=1
url=https://github.com/myshell-ai/MeloTTS
comment=melo
language=Chinese + English
add_blank=1
n_speakers=1
sample_rate=44100
bert_dim=1024
ja_bert_dim=768
speaker_id=1
lang_id=3
tone_start=0
license=MIT license
description=MeloTTS is a high-quality multi-lingual text-to-speech library by MyShell.ai
----------input names----------
0 x
1 x_lengths
2 tones
3 sid
4 noise_scale
5 length_scale
6 noise_scale_w
----------output names----------
0 y


D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx/csrc/offline-tts-vits-impl.h:OfflineTtsVitsImpl:48 rule fst: ./vits-melo-tts-zh
_en/date.fst
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx/csrc/offline-tts-vits-impl.h:OfflineTtsVitsImpl:48 rule fst: ./vits-melo-tts-zh
_en/number.fst
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx/csrc/offline-tts-vits-impl.h:Generate:165 Raw text: hello world,你好世界!This i
s a test of the speech synthesis system.
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx/csrc/offline-tts-vits-impl.h:Generate:172 After normalizing: hello world,你好世
界!This is a test of the speech synthesis system.
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx/csrc/offline-tts-vits-impl.h:Generate:172 After normalizing: hello world,你好世
界!This is a test of the speech synthesis system.
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx\csrc\jieba-lexicon.cc:ConvertTextToTokenIds:77 input text: hello world,你好世界
!This is a test of the speech synthesis system.
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx\csrc\jieba-lexicon.cc:ConvertTextToTokenIds:78 after replacing punctuations: he
llo world,你好世界！This is a test of the speech synthesis system。
D:\a\sherpa-onnx\sherpa-onnx\sherpa-onnx\csrc\jieba-lexicon.cc:ConvertTextToTokenIds:87 after jieba processing: hello_ _
world_,_你好_世界_!_This_ _is_ _a_ _test_ _of_ _the_ _speech_ _synthesis_ _system_.

---

code:
tts = SherpaOnnxCreateOfflineTts(&config);

if (tts == nullptr) {
	std::cerr << "Failed to initialize TTS engine." << std::endl;
	return;
}

const std::string text = "hello world,你好世界!This is a test of the speech synthesis system.";
int32_t sid = 0;
const char* filename =_strdup("./x64/Release/generated.wav");

const SherpaOnnxGeneratedAudio* audio = SherpaOnnxOfflineTtsGenerate(tts, text.c_str(), sid, 1.0);

---

I followed the sample code and ran it, reporting errors as above. Do you have time to take a look?

from sherpa-onnx.

[csukuangfj]

Please update your sherpa-onnx to the latest master, re-build sherpa-onnx, and re-try.

[csukuangfj]

@kyn817046

Does it work for you now?

[kyn817046]

I downloaded and compiled the latest project and still reported this error

[csukuangfj]

Please show

git log

to verify the version of your sherpa-onnx
and please tell us how you build sherpa-onnx and post the build logs.

[kyn817046]

Thank you very much! The latest version can run.

[csukuangfj]

Thank you very much! The latest version can run.

Great!