Saw Wendell do this on the latest GN video and for some reason just knew it needed to be a thing.

  • nixos_fan@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    15 hours ago

    It’s strange to think selfhosted models are systematically more efficient than cloud hosted ones, have you never heard of economy of scale? Of batching?