NickLucche/vllm-force-merge-stats
https://nicklucche.github.io/vllm-force-merge-stats/
I like ML that runs fast (and sometimes works too).
Repositories
NickLucche/review-dashboard
Static web dashboard for GitHub PR review statistics
NickLucche/hf-llms-download-stats
Top LLMs ranking by downloads + stats
NickLucche/vllm-dashboard
NickLucche/stable-diffusion-nvidia-docker
GPU-ready Dockerfile to run Stability.AI stable-diffusion model v2 with a simple web interface. Includes multi-GPUs support.
NickLucche/recipes
Common recipes to run vLLM
NickLucche/ci-infra
This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
NickLucche/my-linux-config
My zsh config for getting up to speed in a new server/VM
NickLucche/dotfiles
NickLucche/vllm-test-blast-radius
NickLucche/vllm-bench
High-performance Rust benchmark client for vLLM serving endpoints.
NickLucche/llm-scripts
NickLucche/perf-eval
Performance benchmark & accuracy evaluation for vLLM
NickLucche/vllm-project.github.io
NickLucche/ai-toy-games
Implementation of toy games and classical AI solvers (+reinforcement learning cameo).
NickLucche/autograd.rs
Simple Deep Learning library in Rust based on ndarray.
NickLucche/vllm-omni
A framework for efficient model inference with omni-modality models
NickLucche/lane-detection
Implementation of a SegnetConvLSTM for Lane Detection, exploiting spatiotemporal relations in data to detect roadlanes
NickLucche/continual-habitat-lab
High Level library for running Habitat-Sim for Continual Learning applications.
NickLucche/llm-d
llm-d is a Kubernetes-native high-performance distributed LLM inference framework
NickLucche/nixl
NVIDIA Inference Xfer Library (NIXL)
NickLucche/image_segmentation
Image Segmentation using k-means, n-cuts and superpixels
NickLucche/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
NickLucche/pete-davidson
NickLucche/aiter
AI Tensor Engine for ROCm
NickLucche/whisper-poc
NickLucche/pdbpp
pdb++, a drop-in replacement for pdb (the Python debugger)
NickLucche/release
Release tooling for OpenShift
NickLucche/text-generation-inference
Development fork of https://github.com/huggingface/text-generation-inference
NickLucche/pyramid-cnn-leaves-segmentation
PyTorch implementation of the Pyramid CNN network from "A Pyramid CNN for Dense-Leaves Segmentation"