I endorse TrueNAS, mainly because ZFS. You want ZFS, I will go so far as to get on a video call with you and go over why, if I need to convince you. I used FreeNAS, the old name for the gratis, BSD-based TrueNAS, and it was brill. There are some very good videos on Youtube made by Allan Jude at Klara Systems if you want to dive in yourself.

I run my two servers on old PCs, and I echo that recommendation. You want room to expand your disk pool when needed, and you want as many cores and as much RAM as you can afford. If you don’t have ECC ram, it’s not a big deal for your files, as long as you’re running ZFS, but I would stick to containers rather than full VMs for your services. I have been using Docker, saved as Compose files, for most of my self-hosted stuff for years, and it’s nice cause I can basically nuke the server anytime Iike, import the zpool, and go start the services right back up.

I run straight Debian & FreeBSD nowadays so I cannot say what exact features are on TrueNAS these days, but ten years ago they had an easy GUI for setting up Jails (the BSD version of containers, sorta, it predates them I believe…), so I would assume that current TrueNAS does the same for Docker on some level.

Old PC running TrueNAS, that is the way.

I feel like this is what the Habsburgs looked like, actually. Those paintings all look like caricatures of these guys.

This whole internet could run on a tiny fraction of what it current consumes, with no drop in service levels… if the extraction of profit from every single interaction was not prioritized.

That being said, I was addressing someone who refused to believe that local inference was even possible on CPU; this tells me that the efforts to present the current grift as the only and inevitable AI outcome is working, on minds that do not fundamentally grasp what the technology is, nor what it’s doing. I think the tech is great, and highly useful - the way they are implementing has perverse incentives and existential outcomes, and it does not have to be that way, but it is, because capitalism.

Listen, everything that they are doing by scorching the planet and turning the tap water brown, could be achieved on CPU or much smaller GPUs on local machines - it’s a question of focused, tight training. What they’re doing instead is literally attempting to build gigantic models that take in absolutely everything (burning real books in the process because fuck history we got money to make) and attempting to sell the idea that this brute force, one-thing-does-it-all approach, which requires us to give up everything else that is good in the world, is the only way forward, and yes, we must build the roko basilisk now.

It’s a big, big grift.

Have to say, when I’m strictly looking for hard info, like, what are the command line switches to achieve the right config for a thing, the AI is pretty much always right. It’s not without use, but Doing Things For You is not its best use.

If you’re running a site that anyone from the public can sign up to, resources are not some afterthought you add to your argument like pepper. Resources are everything. I have been on this Internet since NCSA Mosaic; look up the term “hugged to death”.

NYPA

Sometime in the last two years, the number of people consider themselves to be programmers has at least doubled. We have a giant contingent of people who have never gone through the hell of actually developing a skill but are now “developers” in much the same way that typing “make me a song like ______” now makes you a musician. No theory, no chords, no building of callouses, just load up our AutoPlagio and dance the night away!

And these sudden Developers and such are all very upset at having their legitimacy questioned by a bunch of… of… NERDS.

Response guy seems to think that “legitimate crypto” is a thing.

My SSH keys are legitimate crypto. Fake money for criminals is not legitimate.

You are missing the gnu, if you’re calling it an OS.

I ain’t writing them off just yet.