Features for clustering about mmt

[yxgeee]

Hi, thank you for your question.
Unfortunately, I did not conduct an ablation study on this component with the MMT framework.
But when conducting experiments on baseline models, i.e. training with only hard pseudo labels, I found that cf = (cf_1+cf_2)/2 performed better than simply taking cf_1 or cf_2. I did not try concatenation since this operation will increase the feature dimension, resulting in more computation cost in clustering.

[pmorerio]

Thank you very much for the quick answer!

[pmorerio]

Did you try averaging features also for testing the models?

[yxgeee]

No, I only adopt one model in the inference, i.e. features for testing are output by one model directly.