Hi,
I am trying to start a training from a shell script using aws cli from my linux, but got error.
Code:
A trening fjob creation
CREATE_JOB_OUTPUT=$(aws sagemaker create-training-job
–training-job-name $TRAINING_JOB_NAME
–hyper-parameters ‘{“model_id”:“mistralai/Mistral-7B-Instruct-v0.2”,“epochs”:“1”,“train_batch_size”:“16”}’
–algorithm-specification TrainingImage=“763104351884.dkr.ecr.eu-central-1.amazonaws.com/huggingface-pytorch-training:1.7.1-transformers4.6.1-gpu-py36-cu110-ubuntu18.04",TrainingInputMode="File”
–role-arn $ROLE_ARN
–input-data-config ‘[
{
“ChannelName”: “training”,
“DataSource”: {
“S3DataSource”: {
“S3DataType”: “S3Prefix”,
“S3Uri”: “s3://mistral.training/my_dataset”,
“S3DataDistributionType”: “FullyReplicated”
}
}
}
]’
–resource-config InstanceType=“ml.p3.2xlarge”,InstanceCount=1,VolumeSizeInGB=50
–stopping-condition MaxRuntimeInSeconds=86400
–output-data-config S3OutputPath=$S3_OUTPUT_PATH
)
Error:
Traceback (most recent call last):
File “/opt/conda/lib/python3.6/site-packages/sagemaker_training/trainer.py”, line 85, in train
entrypoint()
File “/opt/conda/lib/python3.6/site-packages/sagemaker_pytorch_container/training.py”, line 121, in main
train(environment.Environment())
File “/opt/conda/lib/python3.6/site-packages/sagemaker_pytorch_container/training.py”, line 73, in train
runner_type=runner_type)
File “/opt/conda/lib/python3.6/site-packages/sagemaker_training/entry_point.py”, line 93, in run
install(name=user_entry_point, path=environment.code_dir, capture_error=capture_error)
File “/opt/conda/lib/python3.6/site-packages/sagemaker_training/entry_point.py”, line 118, in install
entry_point_type = _entry_point_type.get(path, name)
File “/opt/conda/lib/python3.6/site-packages/sagemaker_training/_entry_point_type.py”, line 43, in get
if name.endswith(“.sh”):
Any idea what I am missing here?