DarkLight1337/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
PhD Candidate @ HKUST
Repositories
DarkLight1337/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
DarkLight1337/my-homebrew
A personal FoundryVTT module containing homebrew items.
DarkLight1337/MinkowskiEngine
Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors
DarkLight1337/pycm
Command-line tool for checking Python compatibility
DarkLight1337/CSF
LiDAR point cloud ground filtering / segmentation (bare earth extraction) method based on cloth simulation
DarkLight1337/lm-evaluation-harness
A framework for few-shot evaluation of language models.
DarkLight1337/LongLLaVA
LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
DarkLight1337/llama_index
LlamaIndex is a data framework for your LLM applications
DarkLight1337/filesystem_spec
A specification that python filesystems should adhere to.
DarkLight1337/buildkite-ci
DarkLight1337/pyimorg
Command-line tool for organizing images
DarkLight1337/wiki-template-io
Push/pull templates to/from a wiki using AutoWikiBrowser.