how to train ghostnet? about efficient-ai-backbones

[ppwwyyxx]

You need https://tensorpack.readthedocs.io/tutorial/symbolic.html#use-models-outside-tensorpack

[iamhankai]

What's the version of your tensorflow and tensorpack? I recommend TensorFlow-1.13.1, Tensorpack-0.9.7.

[KnightWin123]

@gtfaiwxm Have you known how to train the Ghostnet?

[iamhankai]

@PistonY Thanks for you attention. We trained GhostNet using the tricks similar to MobileNetV3 paper, including Label smoothing, No decay bias and Dropout.

[iamhankai]

I think you have the training example for your dataset. Just replace your network with GhostNet and train it.

[gtfaiwxm]

OK,thanks

[JayFu]

OK,thanks

Hi , I was going to replace my network with Ghostnet but it keep throwing bug in tensorpack part.
This example works fine with MobileNetv2.
File "/media/e/hujiang/anaconda3/envs/tf/lib/python3.6/site-packages/tensorpack/models/batch_norm.py", line 176, in BatchNorm training = ctx.is_training AttributeError: 'NoneType' object has no attribute 'is_training'

Can you tell me how you handle it ?

[JayFu]

What's the version of your tensorflow and tensorpack? I recommend TensorFlow-1.13.1, Tensorpack-0.9.7.

Oh thanks! I was using tf 1.5.0 and tensorpack 0.9.9 indeed.
But it seems doesn't work after attempt. Got the same error.
Guessing that's because my training example doesn't suit it?
Could tell me any recomending training example?

[iamhankai]

Thanks @ppwwyyxx

[JayFu]

@ppwwyyxx TY

[PistonY]

Hi @iamhankai thanks for sharing this good work. I success training GhostNet 1.3x to 75.78/92.77 top1/top5, it's almost your paper mentioned. Details here
But I use the same training setting with I train MobileNetV3 with some tricks Label smoothing, No decay bias and Dropout.
I see your paper and reply in iamhankai/ghostnet.pytorch#18, it's seem that you don't use any tricks when training this. I've tried MobileNetV3 can't get such high accuracy leaving these tricks.
I wonder what tricks when training, if it's possible I remove these and get same result?

from tensorpack import TowerContext
with TowerContext('', is_training=False):
    model = GhostNet(....)
    model.data_format = 'NHWC'
    image_tensor = tf.placeholder(dtype=np.float32, shape=(7, 320, 320, 3), name='image_tensor')
    logits = model.get_logits(image_tensor)
    print(logits)