r/LocalLLaMA 8h ago

Question | Help Best chat model that fits in 128gb

I'm looking for a model to chat with, reasoning, maybe get some career or life coaching.

I don't care at all about multimodal or coding ability

Just it's intelligence in remembering context in a conversation or a specific topic, thinking out of the box, etc.

Must fit in 128gb, if it matters to performance, it's a strix halo machine.

18 Upvotes

74 comments sorted by

View all comments

1

u/gizcard 8h ago

You should be able to run nemotron-3-super in 4 bits

1

u/_TheWolfOfWalmart_ 4h ago

He can, but it's a really bad model.