/ 20 min
Pricing the fourth bit: every route to 128GB for local AI
Everyone says you need 128GB of memory to run local AI properly. Pricing it out, the number on the box is a ceiling you mostly cannot reach, and the thing you are really buying is one extra bit of precision per weight.