ivaniguarans/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repositories
ivaniguarans/mlx-lm
Run LLMs with MLX
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Run LLMs with MLX