Vishu26/DAWoc

Project for DAWoC - Neural Machine Translation with Attention Mechanism

★ 2Forks 3Jupyter NotebookGitHub ↗Compare
deep-learningneural-machine-translationpython3

README

TESTS

Alt text Alt text

Neural Machine Translation with Attention Mechanism

This project aims to create language to language translation standalone application.

Tools

  • Python
  • Deep learning libraries - Tensorflow or Keras
  • Gui library - QT

Idea

  • The Translation Machine uses an Encoder-Decoder architecture which are made of Recurrent Neural Networks.
  • Attention Mechanism will help the model to efficiently handle large sentences.
  • Basic Building Block - LSTM(Long Short Term Memory) cell or GRU(Gated Recurrent Unit) cell

Tutorials and Readings

Basic Python

+ https://www.youtube.com/watch?v=kJv1QDfp1PM&list=PL1A2CSdiySGJd0LJRRSwQZbPZaDP0q67j

Machine Learning Basics

+ https://machinelearningmastery.com/basic-concepts-in-machine-learning/
+ https://www.analyticsvidhya.com/blog/2017/09/common-machine-learning-algorithms/

Neural Networks

+ https://youtu.be/aircAruvnKk
+ https://www.youtube.com/watch?v=p69khggr1Jo
+ https://www.youtube.com/watch?v=ov_RkIJptwE&list=PL2-dafEMk2A7mu0bSksCGMJEmeddU_H4D&index=7
+ https://www.youtube.com/watch?v=FTr3n7uBIuE&list=PL2-dafEMk2A7mu0bSksCGMJEmeddU_H4D&index=8
+ https://www.youtube.com/watch?v=BwmddtPFWtA&index=10&list=PL2-dafEMk2A7mu0bSksCGMJEmeddU_H4D

Tensorflow Tuts

+ https://www.youtube.com/watch?v=2FmcHiLCwTU&list=PL2-dafEMk2A7EEME489DsI468AB0wQsMV
+ https://www.analyticsvidhya.com/blog/2016/10/an-introduction-to-implementing-neural-networks-using-tensorflow/

LSTM cell

+ https://www.youtube.com/watch?v=y7qrilE-Zlc

Machine Translation

- https://www.youtube.com/watch?v=nRBnh4qbPHI
- https://www.tensorflow.org/tutorials/seq2seq
- https://machinelearningmastery.com/develop-neural-machine-translation-system-keras/

Contributors

Vishu26

Issues