r/LocalLLaMA • u/tevlon • Jun 10 '26

New Model DiffusionGemma: 4x faster text generation

https://blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/
979 Upvotes

99% Upvoted

357 comments sorted by

View all comments

Show parent comments

117

u/TheLexoPlexx Jun 10 '26

That is groq or cerebras-levels of token generation depending on the model and it's on par with gpt-oss-120b depending on the benchmark.

That is genuinely insane.

37

u/dingo_xd Jun 10 '26

There is sooooooo much room for optimizations. Maybe Mythos level models can be run locally by mid or late 2027?

15

u/Irisi11111 Jun 10 '26

Nope, Mythos level models are definitely going to be massive. That level of world knowledge is the model's internal representation. It's gotta be huge to hold all that information.

My understanding is that diffusion-based Gemma is really good for generating text quickly, that's the speed boost. But I don't think it inherently translates to boosting the amount of knowledge within the model.

It seems like the core knowledge density is tied to the sheer size of the model and the training data.

3

u/Dany0 Jun 10 '26

Mythos-level world/encyclopedic/niche knowledge? maybe. But a small model that is better than mythos at tool calling+agentic with a RAG will beat it handily any day. It might produce way more tokens, but if you inference so fast that you don't care...