tiny lemmy

u/enumerator4829

Joined

Posts

Comments

2 points ·

Your numbers are old. If you are building today with anyone ad much as mentioning AI, you might as well consider 100kW/rack as ”normal”. An off-the-shelf CPU today runs at 500W, and you usually have two of them per server, along with memory, storage and networking. With old school 1U pizza boxes, that’s basically 100kW/rack. If you start adding GPUs, just double or quadruple power density right off the bat. Of course, assume everything is direct liquid cooled.

2 points ·

I get the analogy, but it’s more like you have an old version of the software that can’t defend you against the newer fancier stuff. Continuous cat and mouse game.