Isotr0py/pillow-jpegxl-plugin
Pillow plugin for JPEG-XL, using Rust for bindings.
@Inferact | @vllm-project | M.S. @ Sun Yat-Sen University
Repositories
Isotr0py/open-code-review
Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.
Isotr0py/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Isotr0py/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Isotr0py/SakuraLLM-Notebooks
Notebooks to run SakuraLLM on colab
Isotr0py/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Isotr0py/llm-multimodal
Standalone fork of llm-multimodal from SMG
Isotr0py/Isotr0py
Isotr0py/fastokens
Fast Tokens
Isotr0py/vllm-gguf-plugin
vLLM Quantization plugin for GGUF
Isotr0py/image
Encoding and decoding images in Rust
Isotr0py/TorchSpec
A PyTorch native library for training speculative decoding models
Isotr0py/nozomipy-async
Python Async API for nozomi.la
Isotr0py/ggml-libtorch
Isotr0py/earthaccess
Python Library for NASA Earthdata APIs
Isotr0py/recipes
Common recipes to run vLLM
Isotr0py/bart-plugin
vLLM Model plugin for the encoder-decoder BART model
Isotr0py/xformers-prebuild-wheels
xformers prebuild wheels for T4 and P100 GPU, suitable for kaggle notebook environment.
Isotr0py/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Isotr0py/Qwen3-VL-Embedding
Isotr0py/vllm-omni
A high-throughput and memory efficient inference and serving engine for Omni-modality models
Isotr0py/Acolite-GEE-Colab
Isotr0py/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
Isotr0py/llama.cpp
LLM inference in C/C++
Isotr0py/sglang
SGLang is a fast serving framework for large language models and vision language models.
Isotr0py/VLMEvalKit
Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
Isotr0py/mistral-evals
Isotr0py/GalTransl
GalTransl是一套将数个基础功能上的微小创新与对ChatGPT提示工程（Prompt Engineering）的深度利用相结合的galgame自动化翻译工具包，用于制作内嵌式翻译补丁。
Isotr0py/DeepSeek-VL2
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding