HankBO/vllm-omni
A framework for efficient model inference with omni-modality models
Software/ML Engineer. He has a love of music and basketball, and his favorite thing to do is learn somthing new.
Repositories
HankBO/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
HankBO/vllm-metal
Community maintained hardware plugin for vLLM on Apple Silicon
HankBO/router
A high-performance and light-weight router for vLLM large scale deployment
HankBO/triton
Development repository for the Triton language and compiler
HankBO/aiter
AI Tensor Engine for ROCm
HankBO/llama.cpp
LLM inference in C/C++
HankBO/competitive-data-science
Materials for "How to Win a Data Science Competition: Learn from Top Kagglers" course
HankBO/HankBO
Config files for my GitHub profile.
HankBO/open-source-contribution-copilot-prototype
A Multi-Agent AI Assistant for Noob Open-source Contributors
HankBO/IndoorNavClient
MacOS client for Indoor navigation solution
HankBO/indrz-frontend
Open Source client side code of INDRZ indoor wayfinding, mapping, routing system. Mirrored from https://gitlab.com/indrz.
HankBO/indrz-backend
Open source indoor mapping, routing for orientation and wayfinding. Mirrored from https://gitlab.com/indrz.
HankBO/git_lfs_example
How to use Github & LFS to manage a Unity project
HankBO/matrix-matrix-multiply
Algorithms for matrix matrix multiplication, dgemm, only for AVX-256
HankBO/mosaic
The MOSAIC Operating Systems Model and Checker
HankBO/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
HankBO/a-PyTorch-Tutorial-to-Object-Detection
SSD: Single Shot MultiBox Detector | a PyTorch Tutorial to Object Detection
HankBO/mips_assignment_pku
MIPS assignment for Coursera course Computer Architecture