single aduio inference for ast_model about ast

[JeffC0628]

that's the point I missed, it's better now, thanks

[YuanGongND]

Hi Jeff,

Thanks. Which part of the output makes you think it is not correct?

There might be other things - but I noticed that you didn't normalize your fbank, which will likely lead to wrong results. If you use the AudioSet pretrained model, please use:

fbank = (fbank - (-4.2677393)) / (4.5689974 * 2) before returning fbank.

Also, it is highly encouraged to set audioset_pretrain=True when initialize the AST model rather than manually load state_dict. It should be fine in your case, but if your target length is not 1024, the first method will automatically adjust the positional embedding for you.

Please let me know if that helps.

-Yuan

[tsw123tsw]

Hi, Why do you switch torchaudio backend for interence #torchaudio.set_audio_backend("soundfile") ?

[YuanGongND]

@tsw123tsw

I guess it might related to some system package. But it is really not necessary, our official inference sample does not switch the backend. https://colab.research.google.com/github/YuanGongND/ast/blob/master/colab/AST_Inference_Demo.ipynb

-Yuan