khalidalt Goto Github PK

alpaca-lora

Instruct-tune LLaMA on consumer hardware

annotated-transformer

http://nlp.seas.harvard.edu/2018/04/03/attention.html

arabicnlp

This repository contains tutorials and codes of Arabic natural language processing models and tools.

chatrwkv

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

clip_benchmark

CLIP-like model evaluation

convert2instructions

cross-lingual-test-dataset-xtd10

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

eval_t0_deepspeed

Evaluate T0 with DeepSpeed

finetune-gpt2xl

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

gpt_api

improved-diffusion

Text-writing denoising diffusion (and much more)

joud_app

llava

Visual Instruction Tuning: Large Language-and-Vision Assistant built towards multimodal GPT-4 level capabilities.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

machine_translation_evaluation_metrics

mathematics_dataset

This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.

megatron-deepspeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

ml-visuals

🎨 ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.

mt_evaluation

multilingual-clip

OpenAI CLIP text encoders for multiple languages!

multilingual-modeling

multilingual-t0

Multilingual extension of T0

nmatheg

A simple strategy for training and finetuning NLP models for Arabic. Specify the parameters and just wait for the results. A simple design that makes use of the different tools in our NLP pipeline.

open-instruction-generalist

Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks

open_clip

An open source implementation of CLIP.

promptsource

Toolkit for collecting and applying prompts

rwkv-runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

t5x