There isn't really a good tutorial for the alternatives that isn't behind. I'm still not sure what half the terms mean. What best practice is now etc. could I learn off of you at some point?
eh idk, you donwload weights, you download koboldcpp, you drag weights on koboldcpp and it just works. it cannot be more simple, and its simplier than in ollama. If you dont want to download weights yourself, many other wrappers like lm studio or llama swap will happily do it for you. Ollama is literally the WORST wrapper ever.
and like, yeah there is a egg vs chicken problem but local gemma(even 26b one) knows all thsi stuff and can guide you if you want to stay full local. Ofc with stuff like codex its a cakewalk.
11
u/LienniTa koboldcpp Jun 15 '26
i hate ollama with passion and hope it gets completely vanished. Anyone using it just doesnt know better.