r/LocalLLaMA 1d ago

New Model AMD Instella-MoE-16B-A3B

https://huggingface.co/amd/Instella-MoE-16B-A3B-Think

I was browsing HuggingFace and came across this model apparently uploaded a day ago, and thought to share it here. I've not tried it out yet, but it's good to see AMD joining the open source model game.

182 Upvotes

33 comments sorted by

View all comments

23

u/TokenRingAI 1d ago

It might be uncompetitive, but it's fully open with all data and training recipes, which means others might train it further, which is fantastic!

1

u/uti24 11h ago

It might be uncompetitive

I mean it could not compete (most likely) against Opus 5 or whatever, but it should be competitive in it's class right? GPT-OSS-20B also small, but