[Deepspeed ZeRO-Infinity] looking for NVMe device benchmarks

As you may have read that you can extend your CPU memory with NVMe in the latest Deepspeed release (and the integration has been just made available in transformers master).

We are trying to figure how to make the configuration of the NVMe IO section most efficient and need more data from various NVMe devices.

If you have an NVMe device and don’t mind running an approximately 1h benchmark on it while not doing any other IO on it, please follow the instructions here:

and post your results in the comments of that issue.

Real time involvement is probably around ~5-10min of your time to set up the benchmark and share back the results.

Thank you very much!

1 Like