Manuel Romero

@mrm8488 · User

GitHub profile ↗ · Compare

NLP/NLG Senior Engineer. Team lead and Back-End senior dev. Scrum Master and PM/PO by Scrum Alliance.

MAISA AIMadrid, Spain331 followers320 repositories

Repositories

mrm8488/Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

★ 1Forks 0

mrm8488/rlm-minimal

Super basic implementation (gist-like) of RLMs with REPL environments.

★ 1Forks 0

mrm8488/rlm_repl

Recursive Language Models (RLMs) implementation based on the paper by Zhang, Kraska, and Khattab

★ 0Forks 0

mrm8488/lm-vocab-trimmer

Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting irrelevant tokens from its vocabulary. This repository contains a python-library vocabtrimmer, that remove irrelevant tokens from a multilingual LM vocabulary for the target language.

★ 0Forks 0

mrm8488/Cherry_LLM

[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models

★ 0Forks 0

mrm8488/codex

Lightweight coding agent that runs in your terminal

★ 0Forks 0

mrm8488/nanoGRPO

nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)

★ 1Forks 0

mrm8488/ggml-falcon

Experimental "not quite ready" Falcon40B support, see code & commit comments in branch falcon40b

★ 0Forks 0

mrm8488/MobileLLM

MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

★ 1Forks 0