Vikrantpalle/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Repositories
Vikrantpalle/t-sim
Vikrantpalle/kernel_benchmarks
Vikrantpalle/candle
Minimalist ML framework for Rust
Vikrantpalle/xinfer
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
Vikrantpalle/miraie-ac
MirAIe-AC API for Python
Vikrantpalle/jambo
Jambo - JSON Schema to Pydantic Converter
Vikrantpalle/wasmCloud
wasmCloud is an open source Cloud Native Computing Foundation (CNCF) project that enables teams to build, manage, and scale polyglot apps across any cloud, K8s, or edge.
Vikrantpalle/wadm
wasmCloud Application Deployment Manager (wadm) is a Wasm-native orchestrator for managing and scaling declarative wasmCloud applications.
Vikrantpalle/mermaid
Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown
Vikrantpalle/BusDB
Vikrantpalle/GeoChat
Vikrantpalle/HlsParser
Parser for hls playlist files (*.m3u8)