boyiliee / moex Goto Github PK

Hi author,

Thanks for your wonderful work and releasing your code. I have some problems for your code under the ImageNet folder. For your MoEx component in moex_resnet.py, you calculate the mean and std and affine it with the mean and std from another example. But it seems that you have not assign the output result back to your x.

I am not sure if it is wrong? I check the program, the value in the x do not change after going through the moex function.

        if ex_index is not None and moex_layer == 'stem':
            moex(x, ex_index, moex_norm, moex_epsilon, moex_positive_only)

Hi. Thanks for the great repo. I want to apply MoEx on text classification. I was wondering what type of normalization I should use for MoEx on a transformer-based model like RoBERTa to get the mean and std.

Hi,

Thanks for sharing your work. Could you please help provide the visualization code/tool that can generate similar figures like Fig.1 ?