hhy5277 / deep-learning-with-cats

Deep learning with cats (^._.^)

Deep-learning-with-cats

This repository is a "toy" project so I can gain experience building deep neural networks. My first goal is learning to generate pictures of cats with Generative Adversarial Networks (^._.^).

Objectives (so far)

• Generate images of cats using various types of Generative Adversarial Networks (GAN)
  • use DCGAN (Done)
  • use WGAN (Done)
  • use WGAN-GP (Done)
  • use LSGAN (Done)
• Various/Others
  • Preprocess cat images so we get aligned cat faces for much better GAN convergence (Done)
  • Separate cats by size to be better able to generate cats of certain sizes (Done)
  • Fix DCGAN models so that they can adapt to different input image sizes (Done)
  • Keeping log for TensorBoard (Done)
  • Automatic folder setup (Done)
  • Add multi-gpu and non-CUDA option (Done)
  • Option to load previous models (Done)
  • Add log to output (Done)
  • Identify and remove outliers
    • Remove obvious outliers manually (Done)
    • Find outliers based on a certain measure
  • Tweak models structures, maybe LeakyReLU and dropouts in G
  • Try making higher resolutions pictures (Limited by 6gb of GPU RAM)
    • 128 x 128 (Done)
    • 256 x 256
  • Try Self-Normalizing Neural Networks (SELU) as per https://arxiv.org/abs/1706.02515 (Done)
  • Try adding Frechet Inception Distance (FID) as per https://arxiv.org/pdf/1706.08500.pdf
  • Try soft and noisy labels as per https://github.com/soumith/ganhacks
  • Try adding decaying noise to input as per https://github.com/soumith/ganhacks

Needed

• Python 3.6, PyTorch, Tensorflow (for TensorBoard)
• Cat Dataset (https://web.archive.org/web/20150703060412/http://137.189.35.203/WebUI/CatDatabase/catData.html)
• TensorBoard logger (https://github.com/TeamHG-Memex/tensorboard_logger)

To run

$ # Download dataset and preprocess cat pictures 
$ # Create two folders, one for cats bigger than 64x64 and one for cats bigger than 128x128
$ sh setting_up_script.sh
$ # Move to your favorite place
$ mv cats_bigger_than_64x64 "your_input_folder_64x64"
$ mv cats_bigger_than_128x128 "your_input_folder_128x128"
$ # Generate 64x64 cats using DCGAN
$ python Meow_DCGAN.py --input_folder "your_input_folder_64x64" --output_folder "your_output_folder"
$ # Generate 128x128 cats using DCGAN
$ python Meow_DCGAN.py --input_folder="your_input_folder_128x128" --image_size 128 --G_h_size 64 --D_h_size 64 --SELU True
$ # Generate 64x64 cats using WGAN
$ python Meow_WGAN.py --input_folder "your_input_folder_64x64" --output_folder "your_output_folder"
$ # Generate 64x64 cats using WGAN-GP
$ python Meow_WGAN-GP.py --input_folder "your_input_folder_64x64" --output_folder "your_output_folder" --SELU True
$ # Generate 64x64 cats using LSGAN (Least Squares GAN)
$ python Meow_LSGAN.py --input_folder "your_input_folder_64x64" --output_folder "your_output_folder"

To see TensorBoard plots of the losses

$ tensorboard --logdir "your_input_folder"

Results

Discussion of the results at https://ajolicoeur.wordpress.com/cats.

DCGAN 64x64

DCGAN 128x128 with SELU

WGAN 64x64

WGAN-GP 64x64 with SELU