Content by Dilip Patlolla, Wenqing Lan, Mingfeng Yang, Ali Vaziri, Aishwarya Prasad Tonpe, Huseyin Yildiz, Anshul Jain and Aditya Bhamidipati (1)
Dilip Patlolla and coauthors compare Azure ND GB200 v6 and ND GB300 v6 virtual machines with bare-metal systems and InferenceX benchmarks. Their results show closely matched inference throughput and latency across tested models and serving stacks, while highlighting workload-dependent gains, low-concurrency variation and limits on attributing differences to virtualization.
End of content