mjhydri / singing-vocal-beat-tracking Goto Github PK
View Code? Open in Web Editor NEWThis repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and tempo.
License: MIT License