Skip to content
AI
~/justmeandlinux

Writing/Topics/ai

AI

Models and the ideas behind them, with a bias towards what you can run yourself on hardware you own.

7 posts / 15,804 words

/ 20 min

Pricing the fourth bit: every route to 128GB for local AI

Everyone says you need 128GB of memory to run local AI properly. Pricing it out, the number on the box is a ceiling you mostly cannot reach, and the thing you are really buying is one extra bit of precision per weight.

/ 11 min

AI Models Decoded: What Every Self-Hoster Needs to Know

AI Models Decoded: What Every Self-Hoster Needs to Know You've probably tried ChatGPT. Maybe you've heard about running "local AI" on your home server. But between the hype and the technical papers lies a gap — you want to understand what's actually happening…

Drill it instead

Lessons covering the same ground — asked rather than explained.