[FR][TTS][Android]Fibo split about sherpa-onnx

[csukuangfj]

Would you like to contribute?

An alternative is to split a sentence into smaller ones if the number of tokens is greater than some threshold, say, 10.

[csukuangfj]

Please see

sherpa-onnx/sherpa-onnx/csrc/offline-tts-vits-impl.h

Lines 178 to 179 in 9ee2943

	std::vector<TokenIDs> token_ids =
	frontend_->ConvertTextToTokenIds(text, meta_data.voice);

If token_ids[i].tokens.size() is larger than a threshold, then you need to split token_ids[i].tokens into smaller pieces so that each piece's length is smaller than the given threshold.

The basic knowledge is knowing how to split a std::vector<int32_t> into smaller vectors.

[GeminiT369]

I think this should be carefully considered. When the VITS model synthesizes sounds, the pronunciation of a word is related to its context. Improper segmentation may lead to low synthesis effects.

[csukuangfj]

By the way, we can limit the changes only to Persian.

[mablue]

Yes I want,where should start?
Yes your porpuse is fast and simple.
I will work on it.

[mablue]

Please see

sherpa-onnx/sherpa-onnx/csrc/offline-tts-vits-impl.h

Lines 178 to 179 in 9ee2943

	std::vector<TokenIDs> token_ids =
	frontend_->ConvertTextToTokenIds(text, meta_data.voice);

If token_ids[i].tokens.size() is larger than a threshold, then you need to split token_ids[i].tokens into smaller pieces so that each piece's length is smaller than the given threshold.

The basic knowledge is knowing how to split a std::vector<int32_t> into smaller vectors.

Ops cpp ?!! :D
Owkey I will get a try

@GeminiT369 it is very important for someone who uses screen readers.
It will be optional that you use or not use this thing also in languages like persian we want to just have a alternative to e-speak and it doesn't matter if it have very small synthesis effects.
But for for someone with visually problem it's important to have a fast tts.
I think maybe if we can reduce models to 2mb it will fix all problems...but we cant do it.
Or I dont know? Maybe we can?

[danpovey]

Maybe the latency or Mac sentence length can be made tunable? Having finite max sentence length may also prevent OOM.

…

On Mon, Aug 12, 2024, 2:36 AM Fangjun Kuang ***@***.***> wrote: By the way, we can limit the changes only to Persian. — Reply to this email directly, view it on GitHub <#1222 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAZFLO72AJKGZLXPX2C6XWLZRBCUVAVCNFSM6AAAAABMANJRIOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBTGE2DGMJWG4> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>