jaz201107 / dl-experiments

This repository contains some notebooks about:

• Training a Neural Network:

  • Optimization
  • Regulation
  • Initialization
  • Other Task
    • Normalization
    • Attentions

• Hugging Face:

  • Transformer Based Applications

• Paper Replication:

  • Transformer
  • Vision Transformer: In this project, I implement several classic CNN architectures (ResNet, GoogleNet, DenseNet, VGG, EfficientNet, MobileNet)
  • BERT
  • GPT
  • ...

• Contrastive Learning

  • SimCLR