Any documented examples of using DeepSpeed without trainer?

iwatog · January 25, 2023, 7:50pm

I would like to be able to use DeepSpeed with NLP Transformers but I don’t want to use Trainer. Are there any examples of this available?

muellerzr · January 25, 2023, 7:52pm

You can try with Accelerate instead! DeepSpeed

Topic		Replies	Views
Does Trainer hyperparameter search support deepspeed? Beginners	0	162	July 10, 2023
How DeepSpeed interacts with Trainer optimizer DeepSpeed	1	879	October 13, 2021
Is it true that Deepspeed currently does not support regression tasks and only supports softmax-based classification tasks? DeepSpeed	0	233	April 21, 2023
Question about using trainer with DeepSpeed 🤗Transformers	0	341	April 25, 2023
Is really Trainer class support TPU for faster training? DeepSpeed	2	309	October 2, 2022