hmellor/auction-website
An open-source auction hosting system
MLE @huggingface
Repositories
hmellor/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
hmellor/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
hmellor/vllm-bnb-plugin
vLLM Quantization plugin for bitsandbytes
hmellor/transformers-mlinter
Lint modeling, modular, and configuration files for structural conventions
hmellor/vllm-omni
A framework for efficient model inference with omni-modality models
hmellor/flashinfer
FlashInfer: Kernel Library for LLM Serving
hmellor/personal-finance-uk
A collection of utilities and notebooks for analysing your finances
hmellor/vllm-transformers-modelling-backend-tutorial
hmellor/ci-infra
This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
hmellor/lm-evaluation-harness
A framework for few-shot evaluation of language models.
hmellor/recipes
Common recipes to run vLLM
hmellor/sphinx-autodoc2
A Sphinx extension that automatically generates API documentation for your Python packages.
hmellor/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
hmellor/ml-notes
A Quartz fork used to publish ML notes made in Obsidian
hmellor/Marlin
Optimized firmware for RepRap 3D printers based on the Arduino platform.
hmellor/transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
hmellor/production-stack
hmellor/vllm-project.github.io
hmellor/lm-format-enforcer
Enforce the output format (JSON Schema, Regex etc) of a language model
hmellor/flash-attention
Fast and memory-efficient exact attention
hmellor/pytorch-superpixels
A way to use superpixels at run-time with Pytorch
hmellor/simple-selenium
Tools to speed up using Selenium
hmellor/telegram-tools
Tools to speed up using Telegram bots
hmellor/cookie-clicker-bot
A selenium based Cookie Clicker bot