Python3.6
Pytorch 1.4.0
python3 train.py --arch important_sketching_ftt_multi_relu
Architechture:Cifar10 ---> Important Sketching ---> TT Net
python3 cov_input_train.py
Architechture:Pretrained LeNet(untrainable) ---> Covariates ---> Important Sektching ---> WideResNet
1.settings.ALPHA: penaty of not being orthogonal
2.settings.LR: learning rate