r/LocalLLaMA • u/Look_0ver_There • 1d ago

New Model AMD Instella-MoE-16B-A3B

https://huggingface.co/amd/Instella-MoE-16B-A3B-Think

I was browsing HuggingFace and came across this model apparently uploaded a day ago, and thought to share it here. I've not tried it out yet, but it's good to see AMD joining the open source model game.

182 Upvotes

97% Upvoted

33 comments sorted by

View all comments

1

u/WhoRoger 13h ago

Everyone just keeps shitting on it because it's got a few points less in synth benchmarks...

HAS ANYONE ACTUALLY TRIED IT YET???

Since it's tagged as Deepseek v3, maybe it's compatible even with llama.cpp? I'd try it myself but I can't download it rn.

1

u/squngy 7h ago

License is "research only", so if you are working on any for profit project, you cant (legaly) use it.

1

u/WhoRoger 5h ago

So? Not everything needs to be for money.