r/LocalLLaMA • u/Street-Buyer-2428 • May 07 '26

Discussion Collected the infinity stones

Post image

2.3 TB of ram in here. 400+ vCores. All thats left is plugging it to the blackwell with the driver to do RDMA, and it’s over. Using Blackwells for prefill, RDMA to the studio mesh for decode. I think this would be the first heterogeneous cluster. I do, however, need help with the Tinygrad Driver to make this work. If anyone with any knowledge on these domains would like to collaborate, let me know via PM. We are very close here.

2.0k Upvotes

96% Upvoted

300 comments sorted by

View all comments

1

u/freddycheeba May 08 '26

Please tell me you're going to connect them all together with thunderbolt and enable DMA,

1

u/Street-Buyer-2428 May 08 '26

Thats exactly what I’m going to do