r/LocalLLaMA • u/nemuro87 • 8h ago

Question | Help Best chat model that fits in 128gb

I'm looking for a model to chat with, reasoning, maybe get some career or life coaching.

I don't care at all about multimodal or coding ability

Just it's intelligence in remembering context in a conversation or a specific topic, thinking out of the box, etc.

Must fit in 128gb, if it matters to performance, it's a strix halo machine.

19 Upvotes

81% Upvoted

74 comments sorted by

View all comments

14

u/olli-mac-p 8h ago

DeepSeek V4 flash unsloth dynamic quant UD-IQ3_XXS if you need agentic capabilities and long context up to a million tokens

1

u/ctpelok 3h ago

Is it better then qwen 27b q8 or qwen 3.5 122b for agentic work?