A list of awesome work on Sign Language Production (SLP), the automatic translation from Spoken Language sentences to Sign Language Sequences. It contains an extensive literature review of the field of deep-learning based SLP, with all relevant publications.
I am gathering these papers as literature for my PhD, and thought others may be interested. If you have any updates, please feel free to contribute or email me at [email protected].
These are ordered by year, and I try to find the appropriate conference for each.
Changing the Representation: Examining Language Representation for Neural Sign Language Production. Walsh, Saunders, Bowden SLTAT 22 - https://openresearch.surrey.ac.uk/esploro/outputs/conferencePaper/Changing-the-Representation-Examining-Language-Representation/99652965902346
Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation. Suo, Zheng, Wang, Zhang, Yang. https://arxiv.org/pdf/2207.03714.pdf
Towards Automated Sign Language Production: A Pipeline for Creating Inclusive Virtual Humans. Bernhard, Nunnari, Unger et al. PETRA 22 - https://dl.acm.org/doi/abs/10.1145/3529190.3529202
Cartoonized Anonymization of Sign Language Videos. Tze, Filntisis, Roussos, Maragos. IVMSP 22 - https://ieeexplore.ieee.org/abstract/document/9816293
Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production. Saunders, Camgoz, Bowden. CVPR 22 - https://arxiv.org/pdf/2203.15354.pdf
Modeling Intensification for Sign Language Generation: A Computational Approach. Inan, Zhong, Hassan, Quandt, Alikhani. ArXiv - https://arxiv.org/pdf/2203.09679.pdf (code)
Including Facial Expressions in Contextual Embeddings for Sign Language Generation. Viegas, Inan, Quandt, Alikhani. ArXiv - https://arxiv.org/pdf/2202.05383.pdf
Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production. Saunders, Camgoz, Bowden. ArXiv - https://arxiv.org/pdf/2112.05277.pdf
GAN Based Indian Sign Language Synthesis. Krishna, Ukey, Babu. ICVGIP'21 - https://dl.acm.org/doi/pdf/10.1145/3490035.3490301
Non-Autoregressive Sign Language Production with Gaussian Space. Hwang, Kim, Park. BMVC 2021 - https://www.bmvc2021-virtualconference.com/assets/papers/1102.pdf
Towards Fast and High-Quality Sign Language Production. Huang, Pan, Zhao, Tian. ACM 2021 - https://www.semanticscholar.org/paper/Towards-Fast-and-High-Quality-Sign-Language-Huang-Pan/481f18278fc707dd7cf8254da1e68b96f6913326?utm_source=alert_email&utm_content=AuthorCitation&utm_campaign=AlertEmails_DAILY&utm_term=AuthorCitation&email_index=0-0-0&utm_medium=2754082
Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives. Saunders, Camgoz, Bowden. ICCV21 - https://arxiv.org/abs/2107.11317
ANONYSIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation. Saunders, Camgoz, Bowden. FG2021 - https://arxiv.org/abs/2107.10685
Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks. Saunders, Camgoz, Bowden. IJCV2021 - https://link.springer.com/content/pdf/10.1007/s11263-021-01457-9.pdf
Pose-Guided Sign Language Video GAN with Dynamic Lambda. Kissel, Kümmel, Ritter, Hildebrand. ArXiv - https://arxiv.org/abs/2105.02742
Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video. Saunders, Camgoz, Bowden. ArXiv - https://arxiv.org/abs/2011.09846
Machine Translation from Spoken Language to Sign Language using Pre-trained Language Model as Encoder. Miyazaki, Morita, Sano. LREC2020 - https://www.aclweb.org/anthology/2020.signlang-1.23.pdf
Adversarial Training for Multi-Channel Sign Language Production. Saunders, Camgoz, Bowden. BMVC20 - https://www.bmvc2020-conference.com/assets/papers/0223.pdf
SignSynth : Data-Driven Sign Language Video Generation. Stoll, Hadfield, Bowden. ACV Workshop 20 - https://epubs.surrey.ac.uk/858501/ (code)
Can Everybody Sign Now ? Exploring Sign Language Video Generation from 2D Poses. Ventura, Duarta, Giro-i-Nieto. SLRTP Workshop 20. -https://slrtp.com/papers/extended_abstracts/SLRTP.EA.14.018.paper.pdf
Progressive Transformers for End-to-End Sign Language Production. Saunders, Camgoz, Bowden. ECCV20 - http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123560664.pdf (code)
Skeleton-based Chinese Sign Language Recognition and Generation for Bidirectional Communication between Deaf and Hearing People. Xiao, Qin, Yin. Neural Networks 20 - https://www.sciencedirect.com/science/article/abs/pii/S089360802030040X
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks. Stoll, Camgoz, Hadfield, Bowden. IJCV2020 - https://link.springer.com/article/10.1007/s11263-019-01281-2
Neural Sign Language Synthesis: Words Are Our Glosses. Zelinka, Kanis. WACV20 - https://openaccess.thecvf.com/content_WACV_2020/papers/Zelinka_Neural_Sign_Language_Synthesis_Words_Are_Our_Glosses_WACV_2020_paper.pdf
Deep Gesture Video Generation With Learning on Regions of Interest. Cui, Cao, Pan, Zhang, Wang. IEEE Transactions on Multimedia - https://ieeexplore.ieee.org/document/8936484/media#media
NN-Based Czech Sign Language Synthesis. Zelinka, Kanis, Salajka. SPECOM19 - https://link.springer.com/chapter/10.1007/978-3-030-26061-3_57
Cross-modal Neural Sign Language Translation. Duarte. ACM International Conference on Multimedia - https://imatge.upc.edu/web/sites/default/files/pub/cDuarteb.pdf
Sign Language Production using Neural Machine Translation and Generative Adversarial Networks. Stoll, Camgoz, Hadfield, Bowden. BMVC18 - http://bmvc2018.org/contents/papers/0906.pdf
Sign Language Production: A Review. Rastgoo, Kiani, Escalera, Sabokrou. ArXiv - https://arxiv.org/abs/2103.15910
Machine Translation from Text to Sign Language: A Systematic Review. Navroz Kaur Kahlon1 Williamjeet Singh. Universal Access in the Information Society - https://link.springer.com/content/pdf/10.1007/s10209-021-00823-1.pdf
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent