What are the differences and if Trainer can do multiple GPU work, why need Accelerate? Accelerate use only for custom code? (add or remove something)

Trainer and Accelerate

brando June 28, 2023, 10:20pm 3

Topic		Replies	Views
Besides writing your own training loop, is there any other advantage for using it with deepspeed? 🤗Accelerate	2	520	July 4, 2023
Trainer API for Model Parallelism on Multiple GPUs 🤗Transformers	5	3466	September 10, 2024
Same number of optimizations steps with 1 GPU or 4 GPUs? 🤗Accelerate	0	320	March 11, 2023
What does "--multi_gpu" do under the hood? (and how to use it) 🤗Accelerate	7	4756	May 31, 2023
What algorithm Trainer uses for multi GPU training (without torchrun) Beginners	1	831	January 19, 2023