What are the differences and if Trainer can do multiple GPU work, why need Accelerate? Accelerate use only for custom code? (add or remove something)

Trainer and Accelerate

brando June 28, 2023, 10:20pm 3

Topic		Replies	Views
Besides writing your own training loop, is there any other advantage for using it with deepspeed? 🤗Accelerate	2	580	July 4, 2023
Trainer API for Model Parallelism on Multiple GPUs 🤗Transformers	5	4120	September 10, 2024
Same number of optimizations steps with 1 GPU or 4 GPUs? 🤗Accelerate	0	331	March 11, 2023
What does "--multi_gpu" do under the hood? (and how to use it) 🤗Accelerate	7	6323	May 31, 2023
What algorithm Trainer uses for multi GPU training (without torchrun) Beginners	1	906	January 19, 2023