TradeFlockUSA
Tech

Networking silicon, not GPUs, is the hidden bill in every AI cluster

A rack that cannot talk is a very expensive space heater.

James WhitakerTechnology Editor
Network cables in a data center

Network cables in a data center

SANTA CLARA, Calif. — The public conversation about AI hardware still begins and ends with the GPU. The private conversation begins with the switch. Scale-out training jobs die in the fabric long before they die in the math.

Networking vendors said customers who under-bought optics last year are over-correcting this year, pulling in 800G and 1.6T ports on timelines that would have seemed reckless in the last cloud cycle.

That spend does not photograph well. It also does not go away when a cheaper accelerator arrives. Every new chip generation still has to move gradients across a hall.

James Whitaker

Technology Editor

Reports on semiconductors, cloud infrastructure, and the industrial politics of AI.