Comments (3)
(For the original Chinese title: Let's use English here so that the discussion can be read by more people.)
-
We would like to emphasize that the contribution of OpenVoice is not inventing the voice converter (which VITS and other works already did), but the decoupled framework that seperates the voice style and language control from the tone color cloning.
-
This is very simple, but very effective, especially when you want to control styles, accents or generalize to new languages. If you wanted to do the same control on XTTS, it could require a lot of data and computing, and no promise to fluently speak any language.
-
Also see our comments in 2.2 Model Structure - Tone Color Converter, in the last two paragraphs. We acknowledged the previous work on flow-based TTS such as VITS and Glow-TTS, and provided insights to the community of why other methods like HuBert-based method could run into some problems.
-
We also mentioned that the phoneme system can have a huge impact on cross-lingual tone color conversion. This is a insight that VITS and Glow-TTS didn't provide.
In summary, the contribution of OpenVoice is the Decoupled Framework for Voice Cloning, instead of inventing the individual modules used in the openvoice framework.
from openvoice.
Thank you for your reply. Indeed, simplicity and effectiveness are the way to go.
from openvoice.
At the very beginning, when we started working on instant voice cloning, we realized that if we want to flexibly control the voice styles and languages, we should better seperate the generation of voice styles & language from the generation of tone color. This insight, is what openvoice is all about.
from openvoice.
Related Issues (20)
- Support Torch >2.0 HOT 1
- [Feature Request] Run through venv as an alternative to conda HOT 2
- Multi-lingual
- No module named 'commons'
- ERROR: Cannot uninstall 'llvmlite'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
- Will Pytorch 2.x.x support be added? HOT 2
- RuntimeError: Problem when installing silero with version None. HOT 5
- PackagesNotFoundError: The following packages are not available from current channels: - cudatoolkit=11.7 HOT 1
- demo_part2.ipynb is not working HOT 2
- Explain the importance of responsive web design.
- base speaker TTS training codes needed for fair comparison HOT 2
- How to improve pronunciation of technical terms HOT 1
- What do you think about adding German ? HOT 6
- "NameError: name '_silero_get_speech_ts' is not defined" when running demo_part1.ipynb. While openvoice_app.py is running good. HOT 1
- RuntimeError: cuFFT error: CUFFT_INTERNAL_ERROR HOT 5
- About timbre conversion HOT 1
- FileNotFoundError: [WinError 2] The system cannot find the file specified HOT 1
- How do i change the language ? (Multilingual options) HOT 2
- Error installing HOT 2
- 尝试用 edge-tts 和 openvoice 做的同声传译预告片,和真人配音版本打个有来有回! HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openvoice.