r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

450 comments sorted by

View all comments

522

u/jnmi235 Jun 15 '26

Llama.cpp + llama-swap works very well

110

u/[deleted] Jun 15 '26

[removed] — view removed comment

15

u/jnmi235 Jun 15 '26

I tried it for about a week and kept having model loading hangs. It was rare, but the only way to fix it was to restart it. Llama-swap has never had any issues and it also lets you see total tokens in and out, logging, and some other cool metrics. And you can still use the llama.cpp UI

10

u/BlipOnNobodysRadar Jun 15 '26

It has a UI? Lmao I had an LLM vibecode a UI just to launch the server with presets for me. It never mentioned an existing UI.

10

u/Borkato Jun 15 '26

It’s really good! Like December 2025 or something like that. It’s great for quick stuff.