Meta has funded all sorts of open source infrastructure, for a long time. If you want to avoid their funded contributions… TBH, I wouldn’t even know where to begin.

Yeah. Honestly the margins on some of that stuff is already kind of crazy.

Also peripherals like DACs, monitors and such.

Admittedly, no, but this is slowly improving. Stepfun published their SFT dataset, smaller labs are publishing their datasets for task specific tunes. I believe there was another Chinese lab that published bulk pretraining data, but I can’t find it in my history at the moment.

And, notably, these comparatively tiny labs generally aren’t scraping the internet so abusively like OpenAI/Meta. They don’t need as much. Going by statements in their papers, they tend to use existing archives of web data, buy commercial data, or (more recently) generate a lot synthetic data.

If you run Nemotron, from open datasets.

See the dataset table here. There are sections for pretraining and for specific tasks/topics, like STEM, code and such: https://huggingface.co/nvidia

Chinese models are starting to open their pretraining datasets too, albeit slowly.

I mean, I use Linux 90% of the time on a dual boot machine, I’d hate to be stuck on Windows.

…But I use Win11 for gaming.

And I’ve had zero issues for like two years? Admittedly, I have “neutered” features pretty hard, but still.

this new model, couldn’t universities rebuild it with different contexts and study it in ways you can’t reproduce in other models? like, is k2 horizons a good scientific foundation on which to study machine learning?

Not on a university budget, I don’t think.

But there is all sorts of interesting stuff that can be done with a truly open model other than replicating it.

On top of what others said, Nvidia Nemotron is truly open, with an open dataset.

There have been others (like Olmo), but Nemotron was unique in that it was reasonably useful/cutting edge, while other open models before were basically research artifacts.

Thats funny… They have no idea they even exist. They cant see it over their moon-sized ego.

Its a questionable time, as GPU prices are outrageous now, unfortunately.

I have Win11 on a partition, and when heavily neutered, it feels the same as 10 to me.

Whoa nellie.

This was many years ago, when I didnt know much about linux, and yes many lessons were learned. Though I distinctly remember instances where I couldnt update Manjaro packages because of expired certs.

To clarify some points:

• On packages/AUR, I was desperate, because upstream Arch had some critical fixes that werent shipped to Manjaro yet. Clearly this didnt work out well.

• AUR specifically breaks with Manjaro because AUR targets upstream arch as a base. When a dependant Arch package updates, the AUR package immediately updates to that new dependecy if its being maintained. But since Manjaro delays the upstream updates, this AUR package will break if its updated.

• Yes, I know AUR is filled with malware now.

30% should be passed onto you as a higher price.

Perhaps. But for singleplayer games, they should.

EGS is already getting linux compatibility.

In my scenario, maybe EGS launcher with a GoG coat of paint would be better? Honestly I like a more minimal launcher anyway.

Firing Sweeny would be a start.

Mostly, I think it has a PR and direction problem. It works alright, its not crap software, the more money to devs angle is fantastic, but no ones going to use it when its figurehead reminds everyone he’s a big jerk via Tweet every week, or sends its development in precisely the wrong direction.

If I was in charge of EGS, I’d buy GoG, merge under the GoG brand, merge the storefronts, keep the GoG UI for branding but port EGS features over to the buggy Galaxy client.

Keep the GoG DRM free installer option. Keep the reasonable store fee. Dump the toxic EGS brand.

THAT would be a competitor to Steam, and theyd actually have the ethical high ground.

Manjaro was more unstable than Arch ever was, for me.

My experience was:

• They would mess with Arch packages and muck things up.

• It relied on AUR some, which also messed things up.

• 3rd party repos or AUR didn’t work, as its not in sync with upstream arch.

• …Holding back packages didn’t fix anything anyway. It just delayed fixes. I found myself trying to install upstream Arch packages.

It turns out Arch Linux is more tested and “held back” than people give it credit for. There’s little to gain from forking like that, instead of just contributing to upstream arch testing.

Not to mention the cert thing. Manjaro really did let certs expire many times. When I was new to linux, that took me forever to figure out.

It was part of my linux journey long ago, and TBH I bet many still run into in from historical recommendations and popularity.

But I think CachyOS is taking over their “preconfigured arch with the most SEO” spot.

Well, it’s always been Manjaro either way.

Well, yes.

If you can get an Arc GPU at a better price than the equivalent AMD, that’s a huge deal.