download MosaicKD's pre-trained models from Dropbox (266 M) and extract them as "mosaic_core/checkpoints/pretrained/*.pth"
- MosaicKD (This work)
python kd_mosaic.py --lr 0.1 --batch-size 256 --teacher wrn40_2 --student wrn16_1 --dataset cifar10 --unlabeled cifar10 --epoch 200 --lr 0.1 --local 1 --align 1 --adv 1 --balance 10 --gpu 0 --pipeline=multi_teacher python kd_mosaic.py --gpu 0 --pipeline=multi_teacher --teacher wrn40_2 --student wrn16_1 --dataset cifar10 --unlabeled cifar10 --epochs 300 --ckpt_path /root/autodl-tmp/checkpoints/wrn16_1/0828_e300_n20_db128/ --fp16 --logfile wrn300_128 --resume /root/autodl-tmp/checkpoints/wrn16_1/0828_e300_n20_db128/latest.pth