

I run lemonade on my strix halo box, I change the models I use, but the qwens are pretty good.
I access it via Tailscale on my phone, then I have a page I can use. The Lemonade interface forces you into the app, so you’ll want some other interface for your LLMs, as the app is junk.
I used to run llama.cpp and llama swap, but lemonade combines them and makes managing different ai backends easier.



I pointed lemonade at my llama.cpp model folder but it uses json files to configure them. I think it was fine for importing them or you could have an agent write them for you. After that you can manage models inside the app
Overall it wasn’t a huge deal, it’s easier than managing llama.cpp directly with rocm updates.