How to use albumentations in train.py in AWS Sagemaker?

[sandy569]

Hello! I am new to Huggingface and Sagemaker, and I am trying to fine-tune a Huggingface model in Sagemaker using the HuggingFace Estimator.
https://sagemaker.readthedocs.io/en/stable/frameworks/huggingface/sagemaker.huggingface.html

In my train.py file, I need to import and use the albumentations library for data augmentation. I have already installed albumentations in Sagemaker notebook using pip install. However, when I run train.py, it cannot recognize that the albumentations library is installed.

I have looked for solutions to this issue in the forums, but haven’t been able to find a solution that works for me. Can anyone please help me with this issue? Thanks in advance!

Similar question in the forum fyi:

Setting up environment in Sagemaker Studio

Hello everyone, I am currently working on finetuning a DETR object detection model in Sagemaker Studio using a Hugging Face Estimator. I have installed the libraries with pip, as shown below: !pip install transformers datasets huggingface_hub evaluate timm albumentations wandb sagemaker However, when I tried to check the versions of Pytorch and transformers inside the SageMaker Studio notebook, I got the following error: import torch print(torch.__version__) >>>ModuleNotFoundError: No module…