Phil-OSophy-42/llm-d-inference-sim
A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
Repositories
Phil-OSophy-42/llm-d-inference-scheduler
Inference scheduler for llm-d
Phil-OSophy-42/ai-skills-bench
Phil-OSophy-42/NVSentinel
NVSentinel detects and remediates GPU faults on Kubernetes nodes
Phil-OSophy-42/dce-charts-repackage
helm repo add daocloud https://daocloud.github.io/dce-charts-repackage/
Phil-OSophy-42/k8s-ai-bench
A benchmark to evaluate LLMs on Kubernetes tasks
Phil-OSophy-42/matrixhub
Phil-OSophy-42/skillhub
Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.
Phil-OSophy-42/daocloud-skills
Phil-OSophy-42/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
Phil-OSophy-42/HAMi-core
HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container
Phil-OSophy-42/public-image-mirror
很多镜像都在国外。比如 gcr 。国内下载很慢，需要加速。致力于提供连接全世界的稳定可靠安全的容器镜像服务。
Phil-OSophy-42/drun-docs
d.run website
Phil-OSophy-42/workload-variant-autoscaler
Variant optimization autoscaler for distributed inference workloads
Phil-OSophy-42/DaoCloud-docs
DaoCloud Enterprise 5.0 Documentation
Phil-OSophy-42/HAMi
Heterogeneous AI Computing Virtualization Middleware(Project under CNCF)