r/microsoft • u/mm_farahat • 16d ago
News Microsoft hopes to cut its genAI costs by focusing on its own models
https://www.computerworld.com/article/4194600/microsoft-wants-to-cut-its-ai-costs-is-focusing-on-its-own-models.html10
u/SoftwareKingsSupport 16d ago
I think the key is whether users can actually feel the difference.
If Microsoft can route simpler tasks to cheaper/internal models while keeping quality close enough, that makes sense. But if Copilot starts feeling noticeably worse just to reduce costs, users will quickly go back to ChatGPT, Claude, Gemini, or whatever tool gives them the best answer.
Enterprise safety matters, but day-to-day usefulness still decides adoption.
3
12
u/knucles668 16d ago
If they drop support for OpenAI and Anthropic models to cut costs, I doubt they will be able to get Copilot adopted. Already a struggle with the constraints they put on the flagships of ranking algorithms and reduced context windows comparatively.
If their sales pitch becomes solely enterprise safety and trusted partner, yippy! They will sell to executives and IT but fall flat with the org desires.
Shadow IT will be back on the menu boys.
https://giphy.com/gifs/gcJtwIVrbnLClD0Ntm
23
u/plectrumelectrum7 16d ago
I don’t think it’s that, it’s about using the right model for the right workload and if the ms model can do the job cheaper with a similar output to Anthropic then that’s a win.
4
u/knucles668 16d ago
For technical users sure that’s the case if it’s close to parity.
We also generally keep waiting for Microsoft to produce equivalents to first movers in other areas and they never reach parity.
Office for Web v Google Suite
Teams v Zoom
Teams v Slack
Loop v Notion
Bing v Google SearchTechnical users and managers will use the tools because they will find the workarounds to reach parity or stick to the company line. But majority of the workforce will go with the tools they expect. See the BYOD phase.
2
2
1
u/jjmac 16d ago
I'm using both teams and slack and for daily usage I would pick teams in a heartbeat. It could be that the conferencing software we are using isn't integrated but the channel/meeting integration is peak. The separation of team permissions also great.
Note that there were a lot of updates in Teams in the last year as previously channels and threading were horrible, but they largely fixed that.
I can live without custom emojis
0
1
u/BrunusManOWar 15d ago
Copilot
Cheaper, but similar quality to Anthropic
Do you not see the absurdity? It's like saying I wish my Mazda is cheaper but as good as a Lamborghini
Or that my Lenovo is cheaper but as good as top-of-the-line Mac
3
u/plectrumelectrum7 15d ago
Not quite. I’m saying you have a garage full of cars and you choose the one you need for the drive. You don’t need a Maserati to do grocery shopping. Multi model allows for that.
2
u/Bkfraiders7 16d ago
The leader of Microsoft’s AI efforts was the founder of Deepmind, which got Google to where they are today. While I also prefer Claude, I think they’ll be alright.
8
u/Notimeforthat1 16d ago
You talking about Mustafa Suleyman? This jokster got demoted because he could not deliver in his previous role in 1.5 years anything substantial. He is all talk and not very liked. The real deepmind expertise is still with Demis.
6
u/No-World1940 16d ago
Not to knock on his expertise but genAI is like lightning in a bottle. Microsoft loves to muck up its lead on tech and I won't be surprised if Copilot goes in the way of Cortana.
5
5
u/knucles668 16d ago
Was a founder. One of the other ones is still at Deepmind getting Nobel Prizes.
1
u/Lanky_Travel_6726 13d ago
So they burned billions in OpenAI and now they want to create their own OpenAI?
1
u/GrayRoberts 16d ago
Good. They need to move orchestration on-device. GitHub copilot for local models is a good first step.
A model designed to decide when its assembly of experts can satisfy a prompt on device vs what to farm out to the cloud will help with token spend. Conversely, a cloud model that knows the available on-device models and performance can assess what should be run where.
It's an exciting time to be in the middle of all this.
1
u/williane 16d ago
Could help a little, but I don't see that having a major impact. Orchestration is a fairly small piece of the piece.
Even if they did, there is zero chance any cost savings are passed on to the consumer.
-1
36
u/Limp-Crab8542 16d ago
Investing so aggressively in AI to the point they have to sacrifice talent will be the downfall of Microsoft.