It might be better to specify a smaller value for per_device_train_batch_size. I think the default was 8.
https://stackoverflow.com/questions/76921201/cuda-out-of-memory-using-trainer-in-huggingface-during-validation-training-is-f
It might be better to specify a smaller value for per_device_train_batch_size. I think the default was 8.
https://stackoverflow.com/questions/76921201/cuda-out-of-memory-using-trainer-in-huggingface-during-validation-training-is-f