• 0 Posts
  • 8 Comments
Joined 7 months ago
cake
Cake day: April 8th, 2026

help-circle
  • Monument@piefed.worldtoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    12 days ago

    I wouldn’t say I ‘run’ it, but I mess around with it

    I have a base level Mac Mini I got before the price increase a few years ago, also from when models were smaller and my ambitions were less. I’ve contemplated upgrading it, but I have other things to spend my money on.

    M4 processor, 16 gb ram, 256 gb storage, and a 4tb external HDD drive (an old NAS drive).

    It’s fine. It’s mostly a docker machine, but I do throw AI tasks at it a few times a week. Mostly stuff that I just let it chew on for 5-10 minutes and come back to.

    I run openwebui, and have several models I bounce between. I mostly run Gemma4 (Google) and Granite4.2:8B (IBM).

    Editing to add: the self hosted version of all these models, via llama, just in case that was unclear.







  • I use this - IKEA Bilresa scroll wheel. It also comes in a 3 pack for $28.

    I’ve got it working in HomeAssistant, and they’re pretty neat. The knob has a click action, and the remote has a click action, too. Clicks on the remote allow you to select between 3 different ‘channels.’
    In HA, you can set each channel so that the click and scroll does something different. (The blueprint I use has click, long press, double, triple, and quad click, as well as scroll wheel actions.)
    I’m not that fancy - I’ve got each channel’s click action mapped to on/off toggle, and to brightness, color temp, and a hue scroller.