Besides, the technology billionaire also revealed the power of the upcoming AI chatbot Grok.
According to Business Insider, billionaire Elon Musk recently caused a stir in the technology community when he revealed that xAI’s AI chatbot Grok 3 will be trained on 100,000 Nvidia H100 graphics processing units (GPUs). This is a huge number, showing his ambition in creating a powerful and superior AI chatbot.
Elon Musk plans to invest 100,000 H100 chips for Grok 3 chatbot.
With each H100 chip estimated to cost $30,000-$40,000, the total investment in training Grok 3 could be as much as $3-4 billion. While it’s unclear whether xAI bought the chips outright or rented them from cloud service providers, the information does give some indication of the size of Musk’s investment in his AI chatbot project.
The use of 100,000 H100 GPUs also marks a big step up from the previous Grok 2 version, which only needed around 20,000 GPUs for training. This shows that xAI is constantly working to improve the capabilities of the Grok chatbot, aiming to create a superior AI product.
xAI isn’t the only company investing heavily in H100 chips, however. Tech giant Meta has also announced plans to have around 350,000 H100 GPUs by the end of 2024, with a total investment estimated at $18 billion.
The race to develop AI is getting fiercer, and stockpiling H100 chips has become an important factor in attracting and retaining AI talent. This shows the huge potential of AI and the fierce competition among technology companies in this field.
