Tech’s AI arms race is now a GPU land grab

Meta owns 350,000 Nvidia H100 GPUs. That’s $10 billion in chips sitting in server racks, and it’s not even their biggest play — the 16,000 H100s they burned to train Llama 3.1 alone cost $640 million. The company’s op…

The H100 is a $20,000 to $40,000 brick of silicon that powers 80% of the world’s most capable AI models. Every $40,000 unit represents a 3-4 month wait for most buyers, yet Tesla’s Elon Musk claims he can’t get hardwa…

Meta isn’t alone. Andreesen Horowitz owns 20,000 H100s it rents to startups at 20% equity. Tesla’s Musk, who’s been sued for diverting 12,000 chips to xAI, recently claimed he needs 35,000-85,000 H100s by year’s end. …