• 7 Posts
  • 172 Comments
Joined 1 year ago
cake
Cake day: August 25th, 2025

help-circle

  • Ugh they just made new ones.

    Yesterday was _cafe, today was _sh (for shitjustworks) and _lw for Lemmy.world.

    Please keep on reporting when you see it and I’ll get to them as soon as I can.


    For the record, the Lemmy.world TOS requires that any bot account be set as such in their profile, and that any community they post to requires mod approval first.

    Generically speaking, I won’t be approving any. What I mean is any bot request is going to need a valid and real reason for its use here, which I would then bring to the community to make that choice like I did for this discussion thread. I wish there were a better way than a basic upvote or downvote system, but its what we’ve got so its what I’d use.

    I have not posted about any new bots since I took over here a few months ago, so no new bots should be considered as having community approval.

    The acronyms and initialisms bot (can’t remember the name right now) was approved before I joined and everyone seems cool with, I never get reports, so I haven’t bothered with posting about it.

    Edit: WHY IS AUTOCORRECT CHANGING ‘BOT’. So annoying. Anyway, fixed.



  • As a service? No, not really.

    I use llms for specific tasks, usually small models, for things like identification and tagging (immich, paperless), translation or transcription (whisper), etc. I have a bunch of larger models on a Mac mini and my work laptop for various testing purposes, and have used them to make summaries and other such things.

    They aren’t great for search IMO, and search summaries can be quite bad.

    I do find them useful to interrogate an unknown rs232 protocol or similar, though, which is where larger models come in handy.

    Corporate LLMs are generally garbage to me not only because they are just data farming, but also because they really aren’t good at everything. They might claim it, but the reality is a tailored model is often the better approach.

    Using openwebui as a front end for llama.cpp is a decent strategy, combined with sub-agent routing (so generic model hands off to tailored models then returns the right info). This can be useful for some scenarios.

    A caveat on coding - IMO, they are mostly bad at it. If you are using it to generate a small part of something that needs to be repeated they are handy, but at scale they aren’t great, meaning for the entire project (or even an entire plugin or module, depending on complexity). Maintainability becomes a serious issue. While they have improved somewhat, there are limits to what they can do.

    Macs with M series chips are good options for a hardware base since the memory is shared, and IMO is one of the most cost effective options over a dgpu with a ton of memory. A dgpu with a decent bit of memory (say 8-12GB) is a solid choice for a model thats larger (27b with 3 or 4b active as a mixture-of-experts model) especially if you have an iGPU for regular graphics tasks. Since its all shared on the M series macs, just get something that fits entirely in memory there.



  • Generally speaking, I use the app.

    I do, however, have miscellaneous tablets that are in rooms to show information and have a designated account just for that room’s controls. I also have a wall-mounted touch panel that was from a pro control system that I picked up cheap that I rooted and set HA to open at boot, but I don’t recommend this route unless you happen to get/see one cheap and know exactly what can/can’t be done with it.
















  • Completely agree

    My current decision is between a new Motorola signature 27 with graphene (running under the assumption Linux will be able to make the jump there, which isn’t an unreasonable conclusion to jump to), or getting a mostly basic flip phone that can hotspot and using a umpc with it.

    Where Linux phones have failed for me is the limited options for phones and on the actual phone part, so I feel like separation that out with a nice umpc and letting a phone be a phone is a worthwhile option.

    We’ll see how things play out though!