https://prokube.ai/en/blog/ Articles about sovereign AI infrastructure, Kubernetes, MLOps, and agentic workloads. en Wed, 19 Aug 2026 00:00:00 GMT https://prokube.ai/en/blog/serving-qwen38-27b-kserve-vllm/ https://prokube.ai/en/blog/serving-qwen38-27b-kserve-vllm/ Wed, 19 Aug 2026 00:00:00 GMT Dr. Christian Geier A complete KServe setup for Qwen3.8 27B, including a reusable vLLM runtime, BF16 and FP8 deployment settings, H100 NVL validation, and the most important tuning knobs. Qwen3.8 KServe vLLM Kubernetes LLMs https://prokube.ai/en/blog/ai-gateway-api-gateway-gateway-api/ https://prokube.ai/en/blog/ai-gateway-api-gateway-gateway-api/ Sun, 21 Jun 2026 00:00:00 GMT Dr.-Ing. Henrik Steude Why "gateway" in cloud native and AI now means almost anything, and how to avoid losing the plot completely. AI Gateway Kubernetes Gateway API LLMs Agentic AI https://prokube.ai/en/blog/self-hosting-gemma-4-kubernetes-kserve-vllm/ https://prokube.ai/en/blog/self-hosting-gemma-4-kubernetes-kserve-vllm/ Fri, 10 Apr 2026 00:00:00 GMT Reyan Korel Erben Dr. Christian Geier How we ran the Gemma 4 31B instruction-tuned model on a single A100 80GB GPU using KServe and vLLM, including the custom runtime, PVC setup, tuning flags, verification, monitoring, and troubleshooting notes. Gemma 4 KServe vLLM Kubernetes LLMs