mrm8488/shared_colab_notebooks
A Repo to store the Google Colaboratory Notebooks that I have created and shared
NLP/NLG Senior Engineer. Team lead and Back-End senior dev. Scrum Master and PM/PO by Scrum Alliance.
A Repo to store the Google Colaboratory Notebooks that I have created and shared
Simulation of Flappy Birds game using a simple neural network and genetic evolution strategy
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
obliterate the chains that bind you
Super basic implementation (gist-like) of RLMs with REPL environments.
Recursive Language Models (RLMs) implementation based on the paper by Zhang, Kraska, and Khattab
First landing opage for the startup CYBERSECURITAI
The best ChatGPT that $100 can buy.
Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting irrelevant tokens from its vocabulary. This repository contains a python-library vocabtrimmer, that remove irrelevant tokens from a multilingual LM vocabulary for the target language.
[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models
From the Transistor to the Web Browser, a rough outline for a 12 week course
Lightweight coding agent that runs in your terminal
nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
LIMO: Less is More for Reasoning
Experimental "not quite ready" Falcon40B support, see code & commit comments in branch falcon40b
Ongoing research training transformer language models at scale, including: BERT & GPT-2
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
A free + OSS logo generator powered by Flux on Together AI
Fully open reproduction of DeepSeek-R1
Large Concept Models: Language modeling in a sentence representation space