A question about pre-train model? about goturn

[davheld]

Try reducing the learning rate? The oscillations in that graph look fairly large. Although if you are using the default learning rate then this is unusual that you should need to change it. Also, make sure that all convolutional layers are fixed (e.g. in both streams of the network).

[Ouya-Bytes]

yet, i only use your code and prototxt( run the train.cpp, keep params of solver.prototxt and tracker.prototxt) to re-train the network, i don't change anymore. the convolutional layer is from CaffeNet, and lr_mult is set 0 no change.

[davheld]

1. I use the pre-trained CaffeNet architecture, which is available from Caffe:
   http://caffe.berkeleyvision.org/model_zoo.html

2. I think it probably will - if you do this then I recommend using a much smaller architecture.

3. As mentioned above, I do not pre-train the convolutional layers myself but I take the layers pre-trained from Caffe. The two sets of convolutional layers have identical weights.

[Ouya-Bytes]

@davheld I according to your code(tracker.prototxt and solver.prototxt ,iteration 500000) and use the train.cpp to train the network use dataset(2014_DET and ALOV300+), the train loss value is not convergent, and oscillation between on 20 ~ 50 finally.so that have a very pool tracking performance. Can you give me some advise? Thks

[davheld]

It sounds like you are overfitting. Just to be sure - I don't train the conv layers at all, those are pre-trained using CaffeNet.

[davheld]

How do you create the pre-trained network?

[Ouya-Bytes]

the pretrian param from your offer address http://cs.stanford.edu/people/davheld/public/GOTURN/weights_init/tracker_init.caffemodel, i dont change the prototxt, i only want to run train.cpp code to get tracker_iter_500000.caffemodel, then can test the tracker

[davheld]

That's odd, not sure.

[Jiangfeng-Xiong]

I have the same problem, changing val_ratio from 0.2 to 0 in "loader/loader_alov.cpp" may help, but still , model trained by myself doesn't perform as good as pre-train model.

[Ouya-Bytes]

not convergent? oscillation?

[davheld]

The oscillation is normal and simply occurs because the training evaluation is occurring on mini-batches which are randomly sampled at each iteration. However, the numbers that you listed seem lower than what I remember so I believe that you are overfitting, although I am not sure why.

[Jiangfeng-Xiong]

train loss is like this , range from 20 to 90 @OuYag

[ujsyehao]

@OuYag your words"lr_mult is set 0 no change." I don't think it is right, lr_mult set to 0 means no learning rate.
Caffe says that we will set the weight learning rate to be the same as the learning rate given by the solver during runtime

[freescar]

@Jiangfeng-Xiong @OuYag do you solve the issue? I have the same problem, the test loss value is between 10 and 20. I guess it is overfitting, however changing lr or batchsize cannot reduce losses

[wendianwei]

Hi, I want to know how to evaluate your performance?