“Just” and a 27B model don’t exactly belong in the same sentence if you ask my wallet. 💸

I’ve been wanting to do this, even as a testbed. I just want computers to do cool shit, and am getting tired of being a Linux sysadmin in my free time. How large of a model do you have assigned to this?

Copper by weight is cheap as hell. RAM & NVME drives are a WAY better ROI. It wouldn’t even be worth carrying the whole server.