SystemPanic/vllm-windows
A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
Repositories
SystemPanic/flashinfer-windows
FlashInfer: Kernel Library for LLM Serving (Windows build & kernels)
SystemPanic/nccl-windows
Optimized primitives for collective multi-GPU communication
SystemPanic/humming-windows
SystemPanic/pynini-windows
Pynini for Windows
SystemPanic/openfst-windows
OpenFst for Windows
SystemPanic/qutlass
QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
SystemPanic/DeepGEMM-windows
DeepGEMM: clean and efficient BLAS kernel library on GPU (Windows build & kernels)
SystemPanic/spdlog
Fast C++ logging library.
SystemPanic/cutlass
CUDA Templates for Linear Algebra Subroutines
SystemPanic/fastsafetensors-windows
High-performance safetensors model loader
SystemPanic/connect-redis-sessions
Session store using redis-sessions for Connect
SystemPanic/multer-gridfs-storage
🍃 GridFS storage engine for Multer to store uploaded files directly to MongoDb
SystemPanic/tvm-ffi
TVM FFI
SystemPanic/xgrammar
Fast, Flexible and Portable Structured Generation
SystemPanic/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
SystemPanic/websr
Javascript library for running real-time AI Upscaling in the browser
SystemPanic/passport
Simple, unobtrusive authentication for Node.js.
SystemPanic/face-detection
Mediapipe Face Detection (legacy 0.4.1646425229) with Web Worker support
SystemPanic/face-api
FaceAPI: AI-powered Face Detection & Rotation Tracking, Face Description & Recognition, Age & Gender & Emotion Prediction for Browser and NodeJS using TensorFlow/JS
SystemPanic/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
SystemPanic/TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
SystemPanic/minimongo
Client-side in-memory mongodb backed by localstorage with server sync over http
SystemPanic/react-pdf
Display PDFs in your React app as easily as if they were images.
SystemPanic/sendy-api
node.js module for Sendy API
SystemPanic/qbrt
CLI to a Gecko desktop app runtime