lucidrains Goto Github PK

followers: 30.4K following: 0.0 repos: 282.0 gists: 27.0

Name: Phil Wang

Type: User

Bio: Working with Attention. It's all we need

Location: San Francisco

Blog: lucidrains.github.io

Phil Wang's Projects

phasic-policy-gradient

An implementation of Phasic Policy Gradient, a proposed improvement of Proximal Policy Gradients, in Pytorch

phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

pi-gan-pytorch

Implementation of π-GAN, for 3d-aware image synthesis, in Pytorch

pixel-level-contrastive-learning

Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch

point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

ponder-transformer

Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper

product-key-memory

Standalone Product Key Memory module in Pytorch - for augmenting Transformer models

progen

Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax

protein-bert-pytorch

Implementation of ProteinBERT in Pytorch

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

pytorch-optimizer

torch-optimizer -- collection of optimizers for Pytorch

raveforce

RaveForce - An OpenAI Gym style toolkit for music generation experiments.

recurrentjs

Deep Recurrent Neural Networks and LSTMs in Javascript. More generally also arbitrary expression graphs with automatic differentiation.

reformer-pytorch

Reformer, the efficient Transformer, in Pytorch

rela-transformer

Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012

remixer-pytorch

Implementation of the Remixer Block from the Remixer paper, in Pytorch

res-mlp-pytorch

Implementation of ResMLP, an all MLP solution to image classification, in Pytorch

resizeright

The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).

retrieval-augmented-ddpm

Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch

retro-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

revtorch

Framework for creating (partially) reversible neural networks with PyTorch

rgn2-replica

Replication attempt for the Protein Folding Model described in https://www.biorxiv.org/content/10.1101/2021.08.02.454840v1

rita

RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Marks Lab at Harvard.

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

routing-transformer

Fully featured implementation of Routing Transformer

rq-transformer

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"

scattering-compositional-learner

Implementation of Scattering Compositional Learner in Pytorch

se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

segformer-pytorch

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

sinkhorn-transformer

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

lucidrains Goto Github PK

Phil Wang's Projects

Recommend Projects

Recommend Topics

Recommend Org

Jobs