Any documented examples of using DeepSpeed without trainer?

iwatog · January 25, 2023, 7:50pm

I would like to be able to use DeepSpeed with NLP Transformers but I don’t want to use Trainer. Are there any examples of this available?

muellerzr · January 25, 2023, 7:52pm

You can try with Accelerate instead! DeepSpeed

Topic		Replies	Views
Besides writing your own training loop, is there any other advantage for using it with deepspeed? 🤗Accelerate	2	520	July 4, 2023
Does Trainer hyperparameter search support deepspeed? Beginners	0	206	July 10, 2023
Exact difference between Transformers' and Accelerate's DeepSpeed integrations? DeepSpeed	5	653	February 13, 2024
How DeepSpeed interacts with Trainer optimizer DeepSpeed	1	1052	October 13, 2021
Difference between using the Trainer class vs Accelerate library DeepSpeed	0	822	June 27, 2023