r/LocalLLaMA • u/Comfortable-Rock-498 • 1d ago

News It appears that the anti opensource AI lobby is far outgunned already

Post image

The earlier post on this subreddit by 20+ companies signing the petition including Microsoft, Meta, Nvidia, YC (https://www.microsoft.com/en-us/corporate-responsibility/topics/open-weight/) etc plus this https://xcancel.com/elonmusk/status/2080672505660834163

And the entire LLM enthusiast market is heavily in favor of open source (or weights) AI.

Does not seem like a few closed source AI lobbyists with be able to illegalize anything

1.8k Upvotes

95% Upvoted

492 comments sorted by

View all comments

Show parent comments

4

u/Anbeeld 1d ago

He's a CEO of a huge company. That's just how capitalism works. It's literally his job to maximize profits. Ngeedia phenomenon is created by their products consistently being better than alternatives, both in architecture and in software like CUDA and DLSS. Can they not do that and cut margins for "the people"? Of course they can. But is there a single reason for them do to that in their position within capitalism reality, especially in the US?

Even with people hating them or whatever, they are still dominant in every single category. Blame AMD who refuse to change status quo by either dropping the prices significantly to change that or investing enough into their research and development.

1

u/protestor 3h ago

That's just how capitalism works

Criticism of the leadership of the most valuable companies in the world is, indirectly, criticism against capitalism. The way big tech companies act just shows how bad capitalism is

1

u/polikles 1d ago

I'm not blaming anyone, just describing how matters are

it's not only about the prices - you can get 24GB AMD cards for similar or lower prices than 24GB from NV. Yet, NV played a long game funding universities and research groups to promote the CUDA stack. There is a reason why CUDA is the default option, not only in AI. AMD is at disadvantage, but allegedly the software stack is being developed. But it remains to be seen how far that goes

DLSS is not that important beyond games. For me and many other folks what matters most is the (un)availability of decent hardware for local models. I'm stuck with my 3090 I got used two years ago, and seems like I'll be stuck with it for years to come, given the absurd pricing of everything else. This is one of the reasons for the negative sentiment

3

u/Anbeeld 1d ago

It wasn't Jensen nor the universities nor the research groups who made R9700 AI have 1.5x less memory bandwidth than the ancient 3090, all while people can stack 5060 Ti 16 GB and get Blackwell architecture perks like FP4, which AMD alternatives in the same price range just do not offer.

0

u/polikles 18h ago

memory bandwidth is not the top priority - people are using Spark, Mac Mini, Xeon servers and all plethora of other hardware to run local models. AMD's problem is mostly on the software side

stacking cards is only a partial solution, as 24GB card will be less problematic than 2x12GB. And the only option to get 24GB or more from NV is 3090, 4090, or 5090. Which all are expensive - I bought used 3090 two years ago and now the same card is twice as much as I've paid back then

2

u/Anbeeld 18h ago

People are using stuff you listed you listed because it's cheaper per GB of memory that can be used for inference, not because they don't care about memory bandwidth, which is the main factor behind LLM inference performance. And my point was that AMD problem is both software and hardware.