lucidrains Goto Github PK

followers: 30.4K following: 0.0 repos: 282.0 gists: 27.0

Name: Phil Wang

Type: User

Bio: Working with Attention. It's all we need

Location: San Francisco

Blog: lucidrains.github.io

Phil Wang's Projects

scattering-compositional-learner

Implementation of Scattering Compositional Learner in Pytorch

se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

segformer-pytorch

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

simplicial-attention

Explorations into the paper Simplicial Hopfield Networks, to see if any of the learning points can improve upon attention in a transformers setting

sinkhorn-transformer

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

siren-pytorch

Pytorch implementation of SIREN - Implicit Neural Representations with Periodic Activation Function

slot-attention

Implementation of Slot Attention from GoogleAI

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

spear-tts-pytorch

Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch

st-moe-pytorch

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

staged-recipes

A place to submit conda recipes before they become fully fledged conda-forge feedstocks

stam-pytorch

Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification

stylegan

StyleGAN - Official TensorFlow Implementation

stylegan2-pytorch

Simplest working implementation of Stylegan2, state of the art generative adversarial network, in Pytorch. Enabling everyone to experience disentanglement

tab-transformer-pytorch

Implementation of TabTransformer, attention network for tabular data, in Pytorch

tableformer-pytorch

Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch

tensorflow

An Open Source Machine Learning Framework for Everyone

tf-bind-transformer

A repository with exploration into using transformers to predict DNA ↔ transcription factor binding

timesformer-pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

tinygbt-js

A Tiny, Pure Javascript implementation of Gradient Boosted Trees.

token-shift-gpt

Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing

toolformer-pytorch

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

tpdne

Thispersondoesnotexist went down, so this time, while building it back up, I am going to open source all of it.

tr-rosetta-pytorch

Implementation of trRosetta and trDesign for Pytorch, made into a convenient package, for protein structure prediction and design

tranception-pytorch

Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction

transformer-in-transformer

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

transframer-pytorch

Implementation of Transframer, Deepmind's U-net + Transformer architecture for up to 30 seconds video generation, in Pytorch

transganformer

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

lucidrains Goto Github PK

Phil Wang's Projects

Recommend Projects

Recommend Topics

Recommend Org

Jobs