sniperxyp Goto Github PK

ann-benchmarks

Benchmarks of approximate nearest neighbor libraries in Python

bcc

BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more

chunk-attention

deep-learning-with-tensorflow-book

深度学习入门开源书，基于TensorFlow 2.0案例实战。Open source Deep Learning book, based on TensorFlow 2.0 framework.

deeplearning-with-tensorflow-notes

龙曲良《TensorFlow深度学习》学习笔记及代码，采用TensorFlow2.0.0版本

dpdk

Data Plane Development Kit

ebooks-1

faiss

A library for efficient similarity search and clustering of dense vectors.

fastertransformer

Transformer related optimization, including BERT, GPT

fastertransformer_backend

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

gperftools

Main gperftools repository

highway

Performance-portable, length-agnostic SIMD with runtime dispatch

hugectr

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training

jstorm

Java Storm

ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

lookaheaddecoding

powerinfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

redis

Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs, Bitmaps.

rocksdb

A library that provides an embeddable, persistent key-value store for fast storage.

seastar

High performance server-side application framework

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

sniperxypgit

tes1

spark

Mirror of Apache Spark

test

triton

Development repository for the Triton language and compiler

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs