vraiti

@vraiti · User

GitHub profile ↗ · Compare

0 followers38 repositories

Repositories

vraiti/commands

Hand-rolled Python wrappers around the external CLI tools run-remote's toolchain must keep external: ssh, scp, rsync, git, uv.

★ 0PythonForks 0

vraiti/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0PythonForks 0

vraiti/vllm-omni

A framework for efficient model inference with omni-modality models

★ 0PythonForks 0

vraiti/pyo3

Rust bindings for the Python interpreter

★ 0RustForks 0

vraiti/skopeo

Work with remote images registries - retrieving information, images, signing content

★ 0GoForks 0

vraiti/guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

★ 0PythonForks 0