muhtasham / imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

Hello world!

Blog: https://muhtasham.github.io/blog/

🔗 More about work experience in my LinkedIn

Education 🎓

• Master’s degree at Technical University of Munich
  • Sequential Multi-task Learning in NLP with Focus on RegTech Domain
• Bachelor's degree at Sabanci University
  • Diploma thesis: "A Deep Neural Network for SSVEP-based 🧠 Computer Interfaces"
  • Featured in ML Monthly YouTube Show

Projects 🚀

• 📑 StarCoder- May the Source be with you - The StarCoder models are 15.5B parameter models trained on 80+ programming languages from The Stack (v1.2), with opt-out requests excluded. The model uses Multi Query Attention, a context window of 8192 tokens, and was trained using the Fill-in-the-Middle objective on 1 trillion tokens.

• 📑 ECOC based Multi-Class Classification for BCI - Developed DNN, under ECOC framework to detect the character out of 40 possibilities that the (disabled) subject wants to communicate via Brain Computer Interface (BCI).

• 📑 Fault-Tolerant Strassen-Like Matrix Multiplication - Designed parity calculations to make matrix multiplication calculations, using Strassen-Like algorithms on cloud computing environment (with parallel setting) fault-tolerant.

• 📑 TajGPT and TajBERTo - Developed first ever RoBERTa-like language model based on Tajik language after extensive filtering of the dataset. The model can be used for masked text generation or fine-tune it to a downstream task.