Hello, I try to train a ‘modernbert’ model with a trainer. I have 4 available gpus. Yet when I train I see through nvidia-smi that only one gpu is utilized. If I change the model to ‘bert’ and don’t change anything else (same environment etc ) then I get that all 4 gpus are utilized. Did anybod…

Trainer with model modernbert uses only one gpu

ItaiP24 September 17, 2025, 9:59pm 3

thanks,

I will do that

1 Like