guoguo90 Goto Github PK

adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

annotated_deep_learning_paper_implementations

🧑‍🏫 50! Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

cifar

cifar-resnet18-adam

evaluates-performances-cnn-with-adam-and-rmsprop

This repo shares the research that evaluates AlexNet, ResNet and DenseNet with 6 distinct learning rates, and combining with optimizers of Adam and RMSProp.

focnn

Convolutional neural networks

gradient_descent_viz

interactive visualization of 5 popular gradient descent methods with step-by-step illustration and hyperparameter tuning UI

kbfgs_neurips2020_public

machinelearningdeeplearning

李宏毅2021机器学习深度学习笔记PPT作业

pytorch-cifar

95.47% on CIFAR10 with PyTorch

pytorch-optimizer

torch-optimizer -- collection of optimizers for Pytorch

sqn

Sampled Quasi-Newton Methods for Deep Learning

swin-transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

verilog-axi

Verilog AXI components for FPGA implementation

yolov5

YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite

yolov7

Implementation of paper - YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors