saba99 / text-to-audio-chatgpt

Text To Audio (Voice, Music) -Support Chat-GPT

TEXT-To-Audio-Accoustic

Generate Audio from Text and Prompt(Chat-GPT Support)

Steps

1. Prepare running environment

conda create -n audioldm python=3.8; conda activate audioldm
pip3 install audioldm
git clone https://github.com/saba99/Text-To-Audio-ChatGPT; cd AudioLDM

2. Start the web application (powered by Gradio)

python3 app.py

3. A link will be printed out. Click the link to open the browser and play.

Commandline Usage

Prepare running environment

# Optional
conda create -n audioldm python=3.8; conda activate audioldm
# Install AudioLDM
pip3 install audioldm

🌟 Text-to-Audio Generation: generate an audio guided by a text

# The default --mode is "generation"
audioldm -t "A hammer is hitting a wooden surface" 
# Result will be saved in "./output/generation"

🌟 Audio-to-Audio Generation: generate an audio guided by an audio (output will have similar audio events as the input audio file).

audioldm --file_path trumpet.wav
# Result will be saved in "./output/generation_audio_to_audio/trumpet"

Long Example	Long Example	Long Example
Cat.gently.mp4	Peaceful.calmi.mp4	Nature.environ.mp4
Cat gently meowing and purring in long intervels	Peaceful and calming ambient music with singing bowl and other instruments	Nature environmental noise with various bird vocalization, high fidelity, children playing far away and light wind
Temporal Order Control	Temporal Order Control	Temporal Order Control
A.female.is.speaking.mp4	A.racing.car.mp4	Wooden.table.tap.mp4
A female is speaking followed by footstep sound	A racing car is passing by and disappear	Wooden table tapping sound followed by water pouring sound
HUMAN Question For Chat-GPT	HUMAN Question For Chat-GPT	HUMAN Question For Chat-GPT
Describe.sound.battle.mp4	Describe.what.does.mp4	Describe.outter.sound.mp4
Describe the sound of the battlefiled	Describe what does a pop music sound	Describe the sound of the outer space
Simplified Chat-GPT Answer	Simplified Chat-GPT Answer	Simplified Chat-GPT Answer
Loud.chaotic.buzzi.mp4	Pop.music.that.upbeat.mp4	The.steady.crashing.waves.mp4
Loud and chaotic. Hum and buzz of machinery such as power tools, high fidelity. Clanking and clattering of metal parts, the whirring of motors and engines, and the beeping and alarms of various instruments	Pop music that upbeat, catchy, and easy to listen, high fidelity, with simple melodies, electronic instruments and polished production	The steady crashing of waves against the shore,high fidelity, the whooshing sound of water receding back into the ocean, the sound of seagulls and other coastal birds, and the distant sound of ships or boats