ispobock/InferenceX
Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3
Building @sgl-project
Repositories
ispobock/lm-sys.github.io
ispobock/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
ispobock/sgl-attn
Fast and memory-efficient exact attention
ispobock/EAGLE
Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.
ispobock/test-workflow
ispobock/whl
Kernel Library Wheel for SGLang
ispobock/sgl-learning-materials
Materials for learning SGLang
ispobock/outlines
Structured Text Generation
ispobock/flashinfer
FlashInfer: Kernel Library for LLM Serving
ispobock/Torch-TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
ispobock/sglang
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
ispobock/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
ispobock/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
ispobock/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
ispobock/project-based-learning
Curated list of project-based tutorials
ispobock/simple-image-classification
PyTorch implementation for image classification on MNIST/CIFAR10/trashnet.
ispobock/harris-corner-detection
C++ implementation for the Harris Corner Detection algorithm