On troubleshooting, found that the initial or above mentioned error was due to the transformer version. Earlier was using 4.34. Now changed it to 4.36.2
After the change, getting the below error while the logic is trying to download the Model.
**AlgorithmError: ExecuteUserScriptError: ExitCode 1 ErrorMessage "ImportError: /opt/conda/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c106SymIntltEl **
training_function model = AutoModelForCausalLM.from_pretrained(script_args.model_id, File “/opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py”, line 565, in from_pretrained model_class = _get_model_class(config, cls._model_mapping) File “/opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py”, line 387, in _get_model_class supported_models = model_mapping[type(config)] File "/opt/conda/lib/python3.10/site-packag
But the same logic is working (the Model is getting downloaded and also I am able to do some training in the same) when I am running it outside the AWS Sagemaker.