zeroqiaoba / mertools

Toolkits for Multimodal Emotion Recognition

MERTools

Environment

conda env create -f environment.yml

• If raise errors about "OSError: libtorch_cuda_cpp.so: cannot open shared object file: No such file or directory", please run "pip install -U torch torchaudio --no-cache-dir"
• If your Cuda version is low (such as 10.2), please check the install instructions for pytorch-relate packages in "https://pytorch.org/get-started/previous-versions"

MER2023

1. Dataset

To download the dataset, please fill out an EULA and send it to [email protected]. It requires participants to use this dataset only for academic research and not to edit or upload samples to the Internet.

2. Baseline

MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learning
Zheng Lian, Haiyang Sun, Licai Sun, Jinming Zhao, Ye Liu, Bin Liu, Jiangyan Yi, Meng Wang, Erik Cambria, Guoying Zhao, Björn W. Schuller, Jianhua Tao

Please cite our paper if you find our work useful for your research:

@inproceedings{lian2023mer,
  title={Mer 2023: Multi-label learning, modality robustness, and semi-supervised learning},
  author={Lian, Zheng and Sun, Haiyang and Sun, Licai and Chen, Kang and Xu, Mngyu and Wang, Kexin and Xu, Ke and He, Yu and Li, Ying and Zhao, Jinming and others},
  booktitle={Proceedings of the 31st ACM International Conference on Multimedia},
  pages={9610--9614},
  year={2023}
}

code: see ./MER2023

3. Website

http://merchallenge.cn/

MERBench

MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition
Zheng Lian, Licai Sun, Yong Ren, Hao Gu, Haiyang Sun, Lan Chen, Bin Liu, Jianhua Tao

Please cite our paper if you find our work useful for your research:

@article{lian2023mer,
  title={MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition},
  author={Lian, Zheng and Sun, Licai and Ren, Yong and Gu, Hao and Sun, Haiyang and Chen, Lan and Liu, Bin and Tao, Jianhua},
  journal={arXiv:2401.03429},
  year={2024}
}

code: see ./MERBench

MER2024

1. Dataset

To download the dataset, please fill out an EULA and send it to our official email address [email protected]. It requires participants to use this dataset only for academic research and not to edit or upload samples to the Internet.

2. Baseline

MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition
Zheng Lian, Haiyang Sun, Licai Sun, Zhuofan Wen, Siyuan Zhang, Shun Chen, Hao Gu, Jinming Zhao, Ziyang Ma, Xie Chen, Jiangyan Yi, Rui Liu, Kele Xu, Bin Liu, Erik Cambria, Guoying Zhao, Björn W. Schuller, Jianhua Tao

Please cite our paper if you find our work useful for your research:

@inproceedings{lian2023mer,
  title={MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition},
  author={Lian, Zheng and Sun, Haiyang and Sun, Licai and Wen, Zhuofan and Zhang, Siyuan and Chen, Shun and Gu, Hao and Zhao, Jinming and others},
  booktitle={arXiv:2404.17113},
  year={2024}
}

code: see ./MER2024

3. Website

https://zeroqiaoba.github.io/MER2024-website/

mertools's Issues

Ask for MOSEI raw dataset

I would like to kindly request access to the raw dataset for the MOSEI dataset. Our research team is interested in conducting further experiments and feature extraction on this dataset. We appreciate your consideration in granting us access to the raw dataset. Thank you！

page not found

hello,I am interested in your work,but when I try to open https://www.johnvansickle.com/ffmpeg/old-releases%20-%3E%20%20tools/ffmpeg-4.4.1-i686-static,it returns 'page not found',would u please undate the link?thank you very much.

Could you provide alternative link for feature data

Hello, I am deeply interested in your work. Great paper and code base.

But, since I live outside china, It is not possible for me to create Baidu account(I need chinese phone number for that), so I cannot access your feature files.

Could you please provide an alternative link(e.g. Google Drive..) for feature data? It will be a huge help for me and others not living in china. Thanks.

Environment setting

I don't know if I'm running in a LINUX environment or Windows, because there are different system operations in config. How to solve it?

The WeChat group cannot be joined

The WeChat group mentioned here— https://mp.weixin.qq.com/s/70ruqPU8Hk3CgzPoiVQs6w —has reached its limit of 200 members and is currently not joinable by QR code. Could you please invite us to join it?