Introduction to the Nvidia H100 Hoard Meta has 350,000 Nvidia H100 GPUs, worth over $10 billion, to power its AI training infrastructure. This significant investment in hardware is a testament to the high demand for t…

The H100 is a crucial component in training large language models like Meta's Llama 3.1. The company used up to 16,000 H100s to train the model, which has high scores on industry benchmarks. The significant investment…

The Great GPU Heist The demand for H100s has become so high that people are being paid to smuggle them into China, bypassing US export controls. This has led to a thriving black market for the chips, with some sellers…

Tesla is another company that has been collecting H100s, with Elon Musk stating that the company wants to have between 35,000 and 85,000 of the chips by the end of the year. However, Musk has also been accused of redi…