ericjlake

@ericjlake · User

GitHub profile ↗ · Compare

3 followers4 repositories

Repositories

ericjlake/SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, + iOS iPhone app.

★ 1Forks 0