• 0 Posts
  • 12 Comments
Joined 3 years ago
cake
Cake day: June 28th, 2023

help-circle
  • Yes, I installed an LLM at home. I use it for many useful things:

    1. reading novels by translating them from English to my language on the fly via machine
    2. for communicating on lemmy by translating posts and comments
    3. For HomeAssistant
    4. And very rarely for development and searching the internet

    I have a RX9070XT and llama-swap to switch models on the fly. I’m thinking about installing a second RX9070XT so that I don’t take away the translation capability from my lemmy instance while I stress the other neural network with other tasks.





  • I’ve been running all my servers and my work computer on Arch since around 2018, ever since Ubuntu started shoving snaps everywhere. Even the instance I’m writing this from is running Arch. Overall, everything is great. The instance has 98-99% uptime. No issues with the work PC either.

    UPD: While rereading the post, I remembered that rabbitmq was recently broken in the repositories. But everything was solved with a two-minute rollback and blocking of the version in pacman.

    UPD2: I build packages with my hands periodically. It’s not like I haven’t done the same thing on Ubuntu or CentOS. On Arch make PKGBUILD really more easy then spec file for CentOS or deb structure for ubuntu. On Ubuntu this is really awful.


  • Never mind what’s ideal, in reality, one of my servers is running on a Core 2 Duo T7600 and when I installed ubuntu on it, it took 24 minutes to boot due to the unzipping of the base snap image in ubuntu server. Older hardware does not become faster just because os requirements change. And yes, I left ubuntu as soon as snap came out, i think that was 2018.

    UPD: and of course I’m not going to change one of the local servers just because Canonical decided to release another system. Thanks. For 20 years the processor has been routing packets and will do so for another 20 without any problems. Just switched to another OS.






  • nitrolife@hikki.teamtoSelfhosted@lemmy.world•Deleted
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 months ago

    Just don’t expose SSH to internet. It’s a complex protocol with many CVEs. And you realyy don’t need access to SSH from anywhere. Replace access from ineternet to a WireGuard tunnel that has almost zero attack surface area and properly configured iptables rules. And that’s it.