can't reproduce the same AP about pytorch_retinaface

[biubug6]

@twmht I randomly crop image(0.3~1) and scale image to the fixed scale which has the similar effect with multiscale training.

[rydenisbak]

@TIAN-Xiao did you try to use group norm instead batchnorm or freezing batchnorm after pretrain on ImageNet? It's common practice

[biubug6]

Network is easy to shake due to small batch size.

[TIAN-Xiao]

Network is easy to shake due to small batch size.

So, if I wanna reproduce the same AP, I have to have GPUs with large memories so that big batch_size can be used. is it right?

[biubug6]

Yes......

[felixfuu]

@biubug6 Could you share the traning log of mobilenet0.25? When i use this repo to reproduce the result, the batch_size in my config is 512, but i get a lower result:
Easy Val AP: 0.74
Medium Val AP: 0.60
Hard Val AP: 0.29

[rydenisbak]

Original batch_size is 32. You increased it 16 times but number of iteration was decreased 16 times. It's bad. If you increase batch size 16 times you should increase learning rate 16 times for fix this problem.

[felixfuu]

@rydenisbak yeah, i also increased the learning rate to 0.015(~16 times), but the performance is bad.

[twmht]

@biubug6

Why don't you use multiscale training?

[rydenisbak]

@felixfuu anyway final learning rate maybe too high, try cosine lr schedule
https://pytorch.org/docs/stable/optim.html#torch.optim.lr_scheduler.CosineAnnealingLR

[goldwater668]

@biubug6 After training for 50 times, the learning rate remains the same. What's the matter?

[maidouxiaozi]

@twmht我随机裁剪图像（0.3~1）并将图像缩放到与多尺度训练具有相似效果的固定尺度。

The wider validation set enables the input to be fixed with the same shape of the input and the mAP is not low. Because the wider validation set of true labels makes pictures of different sizes

[crj1998]

The batch_size is important, and it will influence the learning rate. when you increase batch_size, lr should also increase, reverse is same.