Xarbirus/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Repositories
Xarbirus/llama.cpp
Port of Facebook's LLaMA model in C/C++
Xarbirus/YouTokenToMe
Unsupervised text tokenizer focused on computational efficiency
Xarbirus/ggml
Tensor library for machine learning