GithubHelp home page GithubHelp logo

glam-imperial / emotionalconversionstargan Goto Github PK

View Code? Open in Web Editor NEW
128.0 7.0 27.0 172 KB

This repository contains code to replicate results from the ICASSP 2020 paper "StarGAN for Emotional Speech Conversion: Validated by Data Augmentation of End-to-End Emotion Recognition".

Python 99.80% Shell 0.20%
generative-adversarial-network stargan stargan-vc data-augmentation emotion-recognition speech-synthesis deep-learning deep-neural-networks icassp-2020 icassp

emotionalconversionstargan's People

Contributors

agkphysics avatar georgiosrizos avatar max-elliott avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

emotionalconversionstargan's Issues

Detailed instructions to train

Hi,Could you please write some detailed instructions on

1.Required datasets
2.Pre-processing data for training
3.How to train

Thanks so much.

which is the directory of Ses01F_impro01.txt?

Session1\dialog\transcriptions
Session1\dialog\MOCAP_rotated
Session1\dialog\MOCAP_head
Session1\dialog\MOCAP_hand
Session1\dialog\EmoEvaluation
which is the directory of Ses01F_impro01.txt?
image

UnboundLocalError: local variable 'dimensions_dis' referenced before assignment

Traceback (most recent call last):
File "/disk2/zhh/EmotionalConversionStarGAN-master/run_preprocessing.py", line 214, in
run_preprocessing(args)
File "/disk2/zhh/EmotionalConversionStarGAN-master/run_preprocessing.py", line 199, in run_preprocessing
generate_world_features(audio_filenames, data_dir)
File "/disk2/zhh/EmotionalConversionStarGAN-master/run_preprocessing.py", line 87, in generate_world_features
wav, labels = get_wav_and_labels(f, data_dir)
File "/disk2/zhh/EmotionalConversionStarGAN-master/utils/data_preprocessing_utils.py", line 111, in get_wav_and_labels
labels = concatenate_labels(category, speaker, dimensions, dimensions_dis)
UnboundLocalError: local variable 'dimensions_dis' referenced before assignment

how to solve this problem?

Learned speech pronunciation problems

Hello.

I ran the same code as the dataset, but I have a problem with the pronunciation part.

Unlike the example voice you uploaded, your pronunciation is crushed and you hear a voice that seems to have drowned.

Please let me know if you know why this problem occurred.

Thank you.

num_emos should be 4 not 3

For anyone trying to reproduce the results, edit the config files so that num_emos is 4, not 3. There are four emotions: angry, happy, sad, and neutral. Since the neutral emotion is assigned the label 3, if num_emos is 3, you will end up excluding the neutral emotion during training.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.