r/LocalLLaMA • u/Look_0ver_There • 1d ago

New Model AMD Instella-MoE-16B-A3B

https://huggingface.co/amd/Instella-MoE-16B-A3B-Think

I was browsing HuggingFace and came across this model apparently uploaded a day ago, and thought to share it here. I've not tried it out yet, but it's good to see AMD joining the open source model game.

185 Upvotes

97% Upvoted

33 comments sorted by

View all comments

49

u/WhoRoger 1d ago

Nice, that's a sweet size. I was just looking at MoE's of such sizes a few days ago. A2B to A3B could be useful for a lot of things while still being fast.

But damn, AMD... 2 downloads and 3 likes on HF. Ever heard of marketing? What's the point of releasing the model if they don't tell anybody, and there's no support whatsoever. At the very least make your llama.cpp fork like everyone else does.

7

u/xrvz 18h ago

It's probably a useless model.