It is reported that tens of thousands of high-end Nvidia GPUs will be used for applications such as deep learning and large language models. The companies aim to make the new supercomputer one of the most powerful AI supercomputers in the world.
Multi-year partnership with Nvidia from Microsoft
As part of its collaboration with Microsoft, Nvidia says it will use Azure virtual machine samples to investigate advances in artificial intelligence or self-learning algorithms that can generate text, code, images, video or audio. (like OpenAI’s GPT-3 or DALL-E 2) Meanwhile, Microsoft will optimize its DeepSpeed library for new Nvidia hardware, aimed at reducing computing power and memory usage during AI training workloads.
The companies didn’t elaborate on when the new supercomputer will be ready, but noted that the announcement marks the start of a “multi-year collaboration.” It also seems likely that the capacity of cloud computing will increase over time.