Saw Wendell do this on the latest GN video and for some reason just knew it needed to be a thing.

  • xbloodymajor@reddthat.com
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    21 days ago

    I like to think of it like solar panels. Sure at first it takes a lot to make, but over time it evens out. I was pretty clear local AI is still morally grey at best, but its a real solution to some problems, an I would argue its better to have local control and use small energy efficient models to do assisting tasks than let the open AI’s of the world decide for us.

    • nixos_fan@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 day ago

      It’s strange to think selfhosted models are systematically more efficient than cloud hosted ones, have you never heard of economy of scale? Of batching?