In this period when the ChatGPT chat robot was storming, it was also on the agenda that Nvidia, which invested heavily in artificial intelligence, would have the biggest share of this storm. Microsoft and Nvidia announced their new partnership.Nvidia H100 doping to Microsoft Azure infrastructure
Microsoft Azure cloud computing infrastructure is powered by Nvidia H100 graphics units. The new servers will run virtual machines and provide space for productive artificial intelligence technologies such as ChatGPT.
As in the case of ChatGPT, the interest in such productive AI technologies is high, and the need for supercomputer-level performance arises. Microsoft also added generative AI technologies to its Bing and Edge products. ND H100 v5 virtual machines built with NVIDIA H100 meet this need of Microsoft Azure infrastructure.
There are 8 Nvidia H100 graphics units in virtual machines. Graphics units can communicate 3.6TB/s internally via NVSwitch and NVLink 4.0 connections. Powered by fourth-generation Intel Xeon scalable processors, the machines offer 64GB/s bandwidth for each GPU and 16-channel DDR5 4800MHz DIMMs.
52773
