jdecker76

@jdecker76 · User

GitHub profile ↗ · Compare

1 followers7 repositories

Repositories

jdecker76/GLM-5.3-Flash-EXL3-DGX-Spark

Run zai-org/GLM-5.3-Flash as an EXL3 4bpw checkpoint on NVIDIA DGX Spark (GB10) with vLLM and cuda-exl3 — measured two-node (TP=2) and three-node (TP=3 + expert parallel) recipes, plus the kernel fixes, NCCL mesh patches, loader work and benchmarks underneath them, and what we retracted.

★ 0Forks 0

jdecker76/GLM-5.3-Flash-NVFP4-TP3-3x-DGX-Spark

Run zai-org/GLM-5.3-Flash (NVFP4) on 3x NVIDIA DGX Spark with vLLM, TP=3 + EP, DFlash2 speculative decoding, CUDA graphs. Full recipe with rationale, benchmarks, patches, and what we tried.

★ 0Forks 0