OutOfMemoryError: CUDA out of memory while trying to replicate this notebook on sagemaker: https://github.com/huggingface/notebooks/blob/main/sagemaker/24_train_bloom_peft_lora/sagemaker-notebook.ipynb

[Jorgeutd]

Thank you Phillip.

@Jorgeutd

'per_device_train_batch_size': 1,