KhalidAlt/Megatron-Bridge
Training library for Megatron-based models with bi-directional Hugging Face conversion capability
Repositories
KhalidAlt/NeMo
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
KhalidAlt/NeMo-RL
Scalable toolkit for efficient model reinforcement
KhalidAlt/pts
Pivotal Token Search
KhalidAlt/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
KhalidAlt/sentence-splitter
Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
KhalidAlt/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
KhalidAlt/ultravox
A fast multimodal LLM for real-time voice
KhalidAlt/llm2vec
Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
KhalidAlt/lm-evaluation-harness
A framework for few-shot evaluation of language models.
KhalidAlt/deduplicate-text-datasets
KhalidAlt/Multilingual-CLIP
OpenAI CLIP text encoders for multiple languages!
KhalidAlt/joud_app
KhalidAlt/youtube_subtitle_dataset
YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training
KhalidAlt/LLaVA
Visual Instruction Tuning: Large Language-and-Vision Assistant built towards multimodal GPT-4 level capabilities.
KhalidAlt/alpaca-lora
Instruct-tune LLaMA on consumer hardware
KhalidAlt/ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
KhalidAlt/gpt_api
KhalidAlt/RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
KhalidAlt/Machine_Translation_Evaluation_Metrics
KhalidAlt/MT_Evaluation
KhalidAlt/improved-diffusion
Text-writing denoising diffusion (and much more)
KhalidAlt/convert2instructions
KhalidAlt/Open-Instruction-Generalist
Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
KhalidAlt/open_clip
An open source implementation of CLIP.
KhalidAlt/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
KhalidAlt/CLIP_benchmark
CLIP-like model evaluation
KhalidAlt/wasf
KhalidAlt/Cross-lingual-Test-Dataset-XTD10
KhalidAlt/nmatheg
A simple strategy for training and finetuning NLP models for Arabic. Specify the parameters and just wait for the results. A simple design that makes use of the different tools in our NLP pipeline.