Is petals the precursor to what spark did for big data in LLMs?

Beginners
1

Looking at this

It feels like we jumped from local straight to a globally distributed model.
But what about GPU clusters? Are there any technologies like spark but for GPUs & LLMs/transformers? What’s the avenue here?