• 0 Posts
  • 32 Comments
Joined 3 years ago
cake
Cake day: June 25th, 2023

help-circle
  • Lemonade is pretty good, especially for AMD GPUs and the lazy, but it’s pretty opinionated (like ollama but not as toxic) and it’s not easy to directly control llama-server parameters. It feels a bit commercial / we want to IPO.

    Seeing as you already have your parameters, llama-swap might be a better fit, lets you configure llama-server directly in a yaml, and switch between them. You can even have multiple versions of the same model (e.g. thinking or not, try out different parameters) and change without reloading.

    Both work fine with e.g. Open WebUI and Pi (lemonade its own integration and llama-server needs an extension).


  • In general I agree, but I’d put any conspiracy higher than AI, that’s just the scam de jour. It would be more along the lines of making conditions favourable for the death of personal computing and other boot on the face of humanity goals. It’s also likely this is a fairly natural evolution of late stage capitalism with technology, no conspiracy needed.

    In this case it’s making lots and lots of GPU datacenters, which after a bubble pop will be useful for making compute a subscription for the masses and processing shittons of video feeds for the surveillance state, and the odd bit of AI.

    This is why I don’t make much of the ‘the chips will be obsolete by the time they’re turned on’ argument, compute is compute, max efficiency or not. Obsolescence might sink a few (or many) companies, but the centralized compute assets will remain and need repurposing. Way too many of those purposes are harmful to the 99%.



  • Weird I know, but IMO it’s best to hand curate books and music (I have comics not manga, but same deal there). Automated tools can quickly rack up more books than you’ll read in a lifetime, and enough new music to listen to for a decade fits in a TB (even mostly FLAC). The problem then becomes finding what to read / listen to next, which gets worse with size.

    That said, having a large local nonfiction book / journal article library can be useful to grep through, especially given current internet search problems.





  • Smartwatch: Garmin (Fenix 6 gen and above if you want sleep monitoring) with gadgetbridge on android (preferably GrapheneOS) and selfhosted Endurain. Seeing as this is c/Selfhosted you can also roll your own dashboards with Grafana.

    You’re thinking Garmin, really? Privacy? Actually Garmin’s T&Cs are IMO the best of the big names privacy wise, especially if you’re in the EU, but they’re publicly traded and subject to the ‘I have altered the deal, pray I don’t alter it any further’ changing terms at their whim, or just getting bought out and drained dry.

    You know what’s better than OK T&Cs? Not giving them any data at all. On gOS I can pull the network permissions for Garmin Connect and still use it to set up the watch, do custom activities and so forth. When finished disable it and enable GadgetBridge. If you want watch faces do that with Connect IQ and then uninstall. Without gOS it’s just a little clunkier, but GB will pull the files off the watch so that when you fire up Connect there’s not data to report. If you didn’t make an account there’s nowhere for it to go anyway.

    There are other gadgetbridge compatible devices but none with the build quality, feature set and quality health data. It’s been running for GB for more than a year and they haven’t sicced their lawyers on it.

    Also, given their spectacular battery lift (14-20 days or so without hammering music or GPS), 500 charges for the battery to decay takes 10 years+, so secondhand ones are good value. The battery can even be replaced fairly easily (4 screws and a bit of glue), although you might not want to go diving afterwards.

    You can also just connect it via USB and use any software that handles GPX etc. files.










  • Don’t understand the downvotes here, even just burying a HDD in a waterproof container in the backyard is way better than 99.9% of users with unencrypted files in OneDrive or iWhateverTheyCallIt. Offline backups are critical against accidental deletion among other things. Part of my 3-2-1 (not buried, just offline), I like old laptops with big SSDs, makes it self sufficient.




  • Eh, just use what you have lying around. My first was my kiddos beat to shit school Thinkpad X230 (figured it was indestructible, wrong, but it still goes, so sorta, with dings, got 'em another cleaner one which still gets used long after school) renewed with Debian. (still a backup, much power saving virtue to laptops as home servers).

    These days it’s just a bunch of podman services (that I can literally drag and drop) on immutable OSs across a few devices, some of which are on all the time (and low power, laptops with gluetun proxies, SearxNG, etc). Some higher power, Immich etc. on the desktop, with shit tons of storage (pre idiocy), that gets turned on for gaming weekly or yeah, local LLM experimentation. I get ppl wanting to play with local servers, more power (heh) to them, hope you’ve got solar and batteries.

    Suppose I was just arguing against the justified purchase premise, or at least the less considered version. If all you have now is a phone, have at it. But consider old (especially business class) laptops. Who doesn’t love built in battery power supply and easy serviceability.

    Good luck OP.