Content by wuyi weng (3)

Wuyi Weng shows how to run Qwen3.8-Flash-Next across two H100 GPUs on an Azure Spot VM, then instrument and troubleshoot it with OpenTelemetry, Application Insights/Azure Monitor, and Grafana. The post focuses on KV-cache behavior under agentic load, dashboard pitfalls, and a vLLM KV-cache FP8 setting that improves concurrency and time-to-first-token.

Wuyi Weng shares a practical, numbers-driven guide to self-hosting the Qwen3.8-27B model on an Azure H100 Spot VM, including the exact vLLM serving flags, a Docker Compose deployment, and an end-to-end observability setup with OpenTelemetry, Application Insights, and Grafana to decide when Spot hosting breaks even.

Wuyi Weng explains how Azure SRE Agent can use an Azure Managed Grafana dashboard (via the MCP endpoint) as executable context to investigate GitHub Copilot telemetry in Application Insights, turning panel queries, variables, and descriptions into fast, accurate triage and per-session diagnoses.