Sean Williams

@SeanThomasWilliams · User

GitHub profile ↗ · Compare

xeed

@xeedio Orlando, FL40 followers27 repositories

Repositories

SeanThomasWilliams/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0PythonForks 0

SeanThomasWilliams/auto-round

SOTA rounding-based quantization for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.

★ 0PythonForks 0

SeanThomasWilliams/django-environ

Django-environ allows you to utilize 12factor inspired environment variables to configure your Django application.

★ 0PythonForks 0