Topic: attention-mechanism Goto Github

👇 Here are 1500 public repositories matching this topic...

atulkum / pointer_summarizer
attention-mechanism,pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
User: atulkum
nlp deep-learning attention-mechanism summarization pointer-networks pytorch-implmention seq2seq-attn

awslabs / sockeye
attention-mechanism,Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Organization: awslabs
Home Page: https://awslabs.github.io/sockeye/
deep-learning deep-neural-networks machine-learning machine-translation neural-machine-translation encoder-decoder attention-mechanism sequence-to-sequence sequence-to-sequence-models sockeye

benedekrozemberczki / awesome-graph-classification
attention-mechanism,A collection of important graph embedding, classification and representation learning papers with implementations.
User: benedekrozemberczki
graph2vec classification-algorithm graph-kernels weisfeiler-lehman kernel-methods deep-graph-kernels netlsd graph-attention-model graph-attention-networks structural-attention attention-mechanism graph-kernel node2vec graph-embedding network-embedding node-embedding graph-representation-learning deepwalk graph-convolutional-networks graph-classification

benedekrozemberczki / simgnn
attention-mechanism,A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).
User: benedekrozemberczki
graph-edit-distance ged graph-similarity gcn graph-convolution tensor-network tensorflow pytorch neural-network deep-learning

blinkdl / rwkv-lm
attention-mechanism,RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
User: blinkdl
attention-mechanism chatgpt deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn rwkv transformer transformers

brightmart / text_classification
attention-mechanism,all kinds of text classification models and more with deep learning
User: brightmart
classification nlp fasttext textcnn textrnn tensorflow multi-label multi-class attention-mechanism text-classification

canjie-luo / moran_v2
attention-mechanism,MORAN: A Multi-Object Rectified Attention Network for Scene Text Recognition
User: canjie-luo
scene-text scene-text-recognition image-deformation image-rectification attention-mechanism

cedrickchee / awesome-transformer-nlp
attention-mechanism,A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
User: cedrickchee
nlp natural-language-processing bert transformer language-model transfer-learning attention-mechanism awesome-list gpt-2 xlnet neural-networks pre-trained-language-models gpt-3 awesome chatgpt gpt-4 llama

charlesxu86 / chatbot_cn
attention-mechanism,基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口
User: charlesxu86
deep-learning chatbot-cn tenserflow-serving intent-detection django-restful reinforcement-learning knowledge-graph slot-filling dialogue-systems ir

chengtan9907 / openstl
attention-mechanism,OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning
User: chengtan9907
Home Page: https://openstl.readthedocs.io/en/latest/
benchmark deep-learning predictive-learning pytorch self-supervised-learning video-prediction weather-forecast awesome-list artificial-intelligence attention-mechanism

cmhungsteve / awesome-transformer-attention
attention-mechanism,An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
User: cmhungsteve
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models

cyberzhg / keras-self-attention
attention-mechanism,Attention mechanism for processing sequential data that considers the context for each timestamp.
User: cyberzhg
Home Page: https://pypi.org/project/keras-self-attention/
keras attention-mechanism

datalogue / keras-attention
attention-mechanism,Visualizing RNNs using the attention mechanism
Organization: datalogue
Home Page: https://medium.com/datalogue/attention-in-keras-1892773a4f22
recurrent-neural-networks attention-mechanism deep-learning deep-neural-networks machine-learning natural-language-processing translation

diego999 / pygat
attention-mechanism,Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
User: diego999
graph-attention-networks attention-mechanism self-attention pytorch neural-networks python

gordicaleksa / pytorch-gat
attention-mechanism,My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
User: gordicaleksa
Home Page: https://youtube.com/c/TheAIEpiphany
gat graph-attention-networks attention-mechanism self-attention pytorch python attention pytorch-gat gat-tutorial deep-learning

gordicaleksa / pytorch-original-transformer
attention-mechanism,My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
User: gordicaleksa
Home Page: https://youtube.com/c/TheAIEpiphany
transformer transformers pytorch-transformer pytorch-transformers attention attention-mechanism attention-is-all-you-need pytorch python jupyter

ibrahimjelliti / deeplearning.ai-natural-language-processing-specialization
attention-mechanism,This repository contains my full work and notes on Coursera's NLP Specialization (Natural Language Processing) taught by the instructor Younes Bensouda Mourri and Łukasz Kaiser offered by deeplearning.ai
User: ibrahimjelliti
Home Page: https://www.coursera.org/specializations/natural-language-processing
machine-learning deep-learning nlp coursera deeplearning-ai specialization neural neural-networks logistic-regression naive-bayes

kyegomez / swarms
attention-mechanism,The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051935506503
User: kyegomez
Home Page: https://docs.swarms.world
artificial-intelligence attention-mechanism gpt4 langchain machine-learning multi-modal-imaging multi-modality multimodal swarms transformer-models

kyubyong / transformer
attention-mechanism,A TensorFlow Implementation of the Transformer: Attention Is All You Need
User: kyubyong
attention-is-all-you-need attention-mechanism implementation transformer translation

linto-ai / whisper-timestamped
attention-mechanism,Multilingual Automatic Speech Recognition with word-level timestamps and confidence
Organization: linto-ai
deep-learning speech speech-recognition speech-to-text asr machine-learning python python3 pytorch attention-is-all-you-need

lucidrains / alphafold2
attention-mechanism,To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
User: lucidrains
artificial-intelligence deep-learning protein-folding attention-mechanism

lucidrains / bottleneck-transformer-pytorch
attention-mechanism,Implementation of Bottleneck Transformer in Pytorch
User: lucidrains
artificial-intelligence deep-learning transformers attention-mechanism image-classification vision

lucidrains / coca-pytorch
attention-mechanism,Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
User: lucidrains
artificial-intelligence attention-mechanism contrastive-learning deep-learning multimodal transformers image-to-text

lucidrains / dalle-pytorch
attention-mechanism,Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
User: lucidrains
artificial-intelligence deep-learning attention-mechanism text-to-image transformers multi-modal

lucidrains / flamingo-pytorch
attention-mechanism,Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
User: lucidrains
artificial-intelligence attention-mechanism deep-learning transformers visual-question-answering

lucidrains / lambda-networks
attention-mechanism,Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
User: lucidrains
artificial-intelligence deep-learning computer-vision attention-mechanism attention

lucidrains / linear-attention-transformer
attention-mechanism,Transformer based on a variant of attention that is linear complexity in respect to sequence length
User: lucidrains
artificial-intelligence deep-learning attention-mechanism transformer pytorch

lucidrains / memorizing-transformers-pytorch
attention-mechanism,Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
User: lucidrains
artificial-intelligence deep-learning attention-mechanism transformers memory retrieval approximate-nearest-neighbors

lucidrains / palm-pytorch
attention-mechanism,Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
User: lucidrains
deep-learning transformers attention-mechanism artificial-general-intelligence

lucidrains / perceiver-pytorch
attention-mechanism,Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
User: lucidrains
artificial-intelligence deep-learning attention-mechanism

lucidrains / performer-pytorch
attention-mechanism,An implementation of Performer, a linear attention-based transformer, in Pytorch
User: lucidrains
artificial-intelligence deep-learning attention-mechanism attention transformers

lucidrains / reformer-pytorch
attention-mechanism,Reformer, the efficient Transformer, in Pytorch
User: lucidrains
artificial-intelligence transformers attention-mechanism machine-learning pytorch

lucidrains / retro-pytorch
attention-mechanism,Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
User: lucidrains
artificial-intelligence deep-learning transformers attention-mechanism retrieval

lucidrains / soundstorm-pytorch
attention-mechanism,Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
User: lucidrains
artificial-intelligence audio-generation deep-learning non-autoregressive transformers attention-mechanism

lucidrains / tab-transformer-pytorch
attention-mechanism,Implementation of TabTransformer, attention network for tabular data, in Pytorch
User: lucidrains
artificial-intelligence deep-learning transformer attention-mechanism tabular-data

lucidrains / timesformer-pytorch
attention-mechanism,Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
User: lucidrains
artificial-intelligence deep-learning attention-mechanism transformers video-classification

lucidrains / vit-pytorch
attention-mechanism,Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
User: lucidrains
artificial-intelligence attention-mechanism transformers computer-vision image-classification

lucidrains / x-transformers
attention-mechanism,A simple but complete full-attention transformer with a set of promising experimental features from various papers
User: lucidrains
artificial-intelligence deep-learning attention-mechanism transformers

petarv- / gat
attention-mechanism,Graph Attention Networks (https://arxiv.org/abs/1710.10903)
User: petarv-
Home Page: https://petar-v.com/GAT/
attention-mechanism graph-attention-networks neural-networks python self-attention tensorflow

philipperemy / keras-attention
attention-mechanism,Keras Attention Layer (Luong and Bahdanau scores).
User: philipperemy
keras keras-neural-networks attention-mechanism attention-model deep-learning

positive666 / yolo_research
attention-mechanism,based on yolo-high-level project (detect\pose\classify\segment\):include yolov5\yolov7\yolov8\ core ,improvement research ,SwintransformV2 and Attention Series. training skills, business customization, engineering deployment C
User: positive666
yolov5 deepstream pytorch object-detection attention-mechanism swintransformer custom-networ yolov7 yolov8

qinzheng93 / geotransformer
attention-mechanism,[CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration
User: qinzheng93
attention-mechanism computer-vision deep-learning neural-network point-cloud point-cloud-registration pytorch registration transformer

richliao / textclassifier
attention-mechanism,Text classifier for Hierarchical Attention Networks for Document Classification
User: richliao
text-classification hierarchical-attention-networks attention-mechanism recurrent-neural-networks convolutional-neural-networks

sgrvinod / a-pytorch-tutorial-to-image-captioning
attention-mechanism,Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
User: sgrvinod
attention-mechanism computer-vision encoder-decoder image-captioning mscoco pytorch pytorch-tutorial show-attend-and-tell

soobinseo / transformer-tts
attention-mechanism,A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
User: soobinseo
attention-mechanism attention-plots deep-learning pytorch pytorch-implementation text-to-speech transformer tts

superbrucejia / eeg-dl
attention-mechanism,A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.
User: superbrucejia
Home Page: https://www.nitrc.org/projects/eeg_dl_library
deep-learning eeg-classification eeg-signals-processing tensorflow motor-imagery-classification eeg-data cnn rnn gcn one-shot-learning

swz30 / mirnet
attention-mechanism,[ECCV 2020] Learning Enriched Features for Real Image Restoration and Enhancement. SOTA results for image denoising, super-resolution, and image enhancement.
User: swz30
image-denoising super-resolution image-enhancement image-restoration low-level-vision computer-vision multi-resolution-streams attention-mechanism pytorch eccv2020

the-ai-summer / self-attention-cv
attention-mechanism,Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Organization: the-ai-summer
Home Page: https://theaisummer.com/
deep-learning transformer transformers self-attention attention-mechanism attention machine-learning machine-learning-algorithms artificial-intelligence

yunjey / show-attend-and-tell
attention-mechanism,TensorFlow Implementation of "Show, Attend and Tell"
User: yunjey
tensorflow image-captioning show-attend-and-tell attention-mechanism mscoco-image-dataset

zzw922cn / awesome-speech-recognition-speech-synthesis-papers
attention-mechanism,Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
User: zzw922cn
automatic-speech-recognition papers roadmap rnn cnn dnn attention-mechanism seq2seq acoustic-model timit-dataset