Meta has 350,000 Nvidia H100 GPUs, each costing up to $40,000. This significant stockpile is part of a larger trend among tech giants to acquire these powerful chips for AI training.

The Nvidia H100 is a highly sought-after piece of technology, used to power the current AI boom. Companies are going to great lengths to acquire these GPUs, including paying individuals to smuggle them into China to b…

The demand for Nvidia H100 GPUs is driven by the need for powerful computing hardware to train large language models. Meta's recent release of Llama 3.1, a large language model, was trained using up to 16,000 Nvidia H…

Other companies, such as Tesla and OpenAI, are also seeking to acquire large quantities of Nvidia H100 GPUs. Tesla's CEO, Elon Musk, has stated that the company aims to have between 35,000 and 85,000 H100s by the end …