Although artificial intelligence tools seem to be at our fingertips, the companies behind these tools have to bear large amounts of expenses to provide services. These companies do not have to be small. Because even one of the most popular names in the industry, OpenAI, is looking for ways to reduce costs.
At this point, the biggest problem is the chip shortage, which you are probably tired of hearing about. While the gaps created by artificial intelligence are rapidly being filled, companies are purchasing a large number of chips at the same time, causing a major shortage in the industry. This pushes even giant companies such as Meta and Microsoft to look for ways to produce their own chips.
ChatGPT’s daily cost was calculated as 700 thousand dollars.
This huge amount will increase even more as ChatGPT becomes more widespread. That’s exactly why OpenAI is looking to produce its own artificial intelligence chips, people familiar with the company’s plans say. He even had his eye on certain companies for this purpose. No concrete steps have been taken yet, but the company has been looking for a solution to expensive chips since last year.
One of these ways is to work with both Nvidia and different suppliers other than Nvidia. Previously, CEO Sam Altman had stated that purchasing a large number of chips was the company’s priority – as other companies have done – and made complaints about the lack of GPU availability. This market is also controlled by Nvidia with a rate of more than 80 percent.
The technologies introduced by OpenAI were made with a supercomputer created by Microsoft. It is stated that 10,000 Nvidia GPUs are used in this computer.
ChatGPT appears as a high-cost initiative for OpenAI. According to analysis, each query made on ChatGPT costs 4 cents. If these queries grow to even just one-tenth the rate of Google searches, it would require approximately $48.1 billion worth of GPUs and approximately $16 billion worth of chips per year to keep the system running. This means huge amounts of money for the company.
For now, it is unknown whether the company will take concrete steps on this issue. Although OpenAI tests the chips developed by Microsoft, it will take a long time and require a huge amount of investment for the company to produce its own chip. It is not certain that this initiative will be successful either. What do you think about it?