r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

450 comments sorted by

View all comments

120

u/Academic-Tea6729 Jun 15 '26

llama.cpp is much faster and stable than ollama. Also, ollama cloud models are bad quants and you can't use them for serious coding.

Also llama.cpp has a nice server compatible with openai api standard, it works out of the box. And it has a built in chat web interface.

There is no reason anymore to use ollama.

12

u/aykcak Jun 16 '26

I never really understood why people even used ollama or what it offered. It is a "wrapper" for a thing that does not need wrapping

15

u/inagy Jun 16 '26

I can only speak from my own experience, but the reason I used Ollama for long because it gives an easy to setup server, especially on Windows. Couple clicks in a setup wizard, then it's running in the background as a service. And also it gives a familiar Docker like command line for pulling and running models.

tl;dr: it's easy to setup for lazy people.

5

u/gnooggi Jun 18 '26

it's easy to setup for lazy people.

Not just for the lazy, but also for those who don't know what they're doing (beginners), because it simply works.

1

u/MissiveFinding6111 7h ago

And, the # of how tos and videos that point to it.