Hi everyone! Repo at https://github.com/asystemoffields/disco-torch, includes a colab notebook you can use to try it for yourself, as well as an API. Weights are hosted on Hugging Face.
I read the Nature article about this (https://www.nature.com/articles/s41586-025-09761-x) and wanted to experiment with it for training LLMs. A barrier was that most of that’s done via PyTorch and this was originally a JAX project. Now it’s in PyTorch too! I hope this could be useful- I’m looking forward to experimenting with it.