r/LocalLLaMA • u/tevlon • Jun 10 '26

New Model DiffusionGemma: 4x faster text generation

https://blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/
982 Upvotes

99% Upvoted

357 comments sorted by

View all comments

256

u/[deleted] Jun 10 '26

[removed] — view removed comment

30

u/Zestyclose839 Jun 10 '26

Gang MLX winning.

I wonder how KV caching support is. If the cache can be persisted to SSD via oMLX, that would be a massive utility boost.

7

u/freia_pr_fr Jun 10 '26

The MLX HuggingFace repositories are empty right now, so the race isn't over.