Hi @philschmid , I liked very much your post “ Hugging Face Transformers BERT fine-tuning using Amazon SageMaker and Training Compiler ” (and its promises of saving time and money when training NLP models :slight_smile: ) and I did try it with a T5 model. However, I got the following error: The train…

Hey @pierreguillou , could you share how you created your Training Job (python estiomator + hyperparameters) and the training script you use? Iin addition to this, I am not sure if T5 is well supported yet. As mentioned in my blog The Amazon Training Compiler works best with Encoder Type models, …

Training compiler for all NLP models?

Amazon SageMaker

pierreguillou January 5, 2022, 7:51pm 3

Thanks for your answer @philschmid. Do you plan to work on it?

Topic		Replies	Views
Fine-tune sentence transformer model on SageMaker Amazon SageMaker	0	982	December 21, 2022
Finetuning sentence embedding model with SageMaker - how to compute loss? Amazon SageMaker	9	3940	December 21, 2022
Can I train and deploy a sentence transformer model using Huggingface estimator Models	0	641	June 6, 2022
Use my finetuned Bert Model in SageMaker BatchTransform Amazon SageMaker	4	2961	April 30, 2022
Transformers 4.9.0 on SageMaker Amazon SageMaker	12	1965	March 25, 2022

Training compiler for all NLP models?

Related topics