sywangyi Goto Github PK

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

haystack

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.

hf-diffusers-sd-finetuning

intel-extension-for-transformers

Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

neural-compressor

Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

optimum-intel

Accelerate inference of 🤗 Transformers with Intel optimization tools

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

testcase

HF testcase

text-generation-inference

Large Language Model Text Generation Inference

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

transformers-bloom-inference

Fast Inference Solutions for BLOOM

trl

Train transformer language models with reinforcement learning.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs