jusperlee / afrcnn-for-speech-separation

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

Hey 👋🏽, I'm Kai Li!

       

My name is Kai Li (Chinese name: 李凯). I'm a second-year master student at Department of Computer Science and Technology, Tsinghua University, supervised by Prof. Xiaolin Hu (胡晓林). I am also a member of TSAIL Group directed by Prof. Bo Zhang (张拨) and Prof. Jun zhu (朱军). I am an intern at Tencent AI Lab, mainly doing research on causal speech separation, supervised by Yi Luo (罗艺).

🤗   These works are open source to the best of my ability.

🤗   I am currently doing research on multimodal speech separation, and am interested in other speech tasks (e.g., pre-training models and neuralscience). If you would like to collaborate, please contact me. Many thanks.

🔖 Homepages

: Kai Li     : Jusper Lee     : cslikai.cn

📅 News

• 2023.07: 🎲 One paper is accepted by ECAI 2023.
• 2023.05: 🧩 Two papers are accepted by Interspeech 2023.
• 2023.05: 🎉 We won the first prize 🥇 of the Cinematic Sound Demixing Track 23 in the Leaderboard A and B.
• 2023.05: 🎉 We won the first prize 🥇 of the ASC23 and Best Application Award.
• 2023.04: 🎲 One paper is appeared by Arxiv.
• 2023.02: 🧩 One paper is accepted by ICASSP 2023.
• 2023.01: 🧩 One paper is accepted by ICLR 2023.

📰 Selected Publications:

See Google Scholar for a full list of publications.

Speech Separation

• An efficient encoder-decoder architecture with top-down attention for speech separation. Kai Li, Runxuan Yang, Xiaolin Hu. ICLR 2023.
• An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuits. Kai Li, Fenghua Xie, Hang Chen, Kexin Yuan, Xiaolin Hu. Arxiv 2022.
• Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network Xiaolin Hu, Kai Li, Weiyi Zhang, Yi Luo, Jean-Marie Lemercier, Timo Gerkmann. NeurIPS 2021.

Neuroscience

• Inferring mechanisms of auditory attentional modulation with deep neural networks. Ting-Yu Kuo, Yuanda Liao, Kai Li, Bo Hong, Xiaolin Hu. Neural Computation 2022.

Cloud Removal

• PMAA: A Progressive Multi-scale Attention Autoencoder Model for High-Performance Cloud Removal from Multi-temporal Satellite Imagery. Xuechao Zou, Kai Li, Junliang Xing, Pin Tao#, Yachao Cui. ECAI 2023.

Super Resolution

• A Survey of Single Image Super Resolution Reconstruction. Kai Li, Shenghao Yang, Runting Dong, Jianqiang Huang, Xiaoying Wang. IET Image Processing 2020.
• Single Image Super-resolution Reconstruction of Enhanced Loss Function with Multi-GPU Training. Jianqiang Huang, Kai Li, Xiaoying Wang. ISPA 2019.

afrcnn-for-speech-separation's Issues

关于文章解读和预训练模型的一些小问题

大佬，请问你的会出一篇文章详细讲解一下这篇paper嘛？另外GitHub上可不可以给一个预训练模型的链接呢？我想复现一下，谢谢！

关于模型

请问AFRCNN和AFRCNN（sum）哪个训练的比较快呢？，我昨晚跑了AFRCNN（sum）用的v100(32G)服务器，一个晚上貌似只跑了2个epoch，学长是不是用了多卡训练？

关于噪声

李学长好，请问您这篇文章最终是否有把噪声单独分离出来？