★ Star the Project
Version
All recipes
Every validated recipe in one table: model, size, architecture, precision, and the verified hardware. Select a row for the full recipe.
| Model | Size | Arch | Precision | Verified on | Notes |
|---|---|---|---|---|---|
| Qwen3-8B qwen | 8B | Dense | BF16 | EKS L4 | An 8.2B dense chat model on one NVIDIA L4. |
| Qwen2.5-7B qwen | 7B | Dense | AWQ INT4 | Vultr A16 | A 7B dense chat model (AWQ INT4) on one NVIDIA A16 on Vultr. |
| Qwen2.5-0.5B on AMD qwen | 0.5B | Dense | BF16 | Existing MI325X | A 0.5B dense chat model on one AMD Instinct MI325X on a bring-your-own cluster. |
| Qwen2.5-0.5B on CPU qwen | 0.5B | Dense | BF16 | Civo CPU | A 0.5B dense chat model served on CPUs alone, on a Civo CPU pool. |
| Qwen3-Coder-480B qwen | 480B A35B | MoE | BF16 / FP8 | EKS H200 | A 480B code MoE, multi-node BF16 over EFA or single-node FP8 on SGLang. |
| Qwen2.5-72B qwen | 72B | Dense | AWQ INT4 | AKSNebius A100H100 | A 72B dense chat model (AWQ INT4) on one 80 GB GPU, on AKS and Nebius. |
| Kimi K3.1 Pro moonshotai | 2.8T A104B | MoE | MXFP4 | EKS B300 | A 2.8T hybrid-attention MoE served by SGLang on one 8x B300 node. |
| Llama-3.1-8B meta-llama | 8B | Dense | BF16 | EKSGKE L4 | An 8B dense chat model on one NVIDIA L4. |
| GLM-4.5-Air zai-org | 106B A12B | MoE | GGUF IQ4_XS | GKE A100 | A 106B MoE served from a GGUF checkpoint via llama.cpp on one A100. |
| Nemotron-3.5-Lightning nvidia | 30B A3B | MoE | NVFP4 | Nebius H100 | An open 30B MoE with 3B active parameters served NVFP4 on one H100 on Nebius. |
| Laguna-S-2.1 poolside | 118B A8B | MoE | FP8 | Nebius H100 | A 118B code MoE served FP8 on one 8x H100 node on Nebius. |