ValueError: Source directory does not exist in the repo. Training causal lm in sagemaker

Thanks for pointing this out with transformers 4.6.1 the examples/ structure changed.
It is for source_dir now →

source_dir=’examples/pytorch/language-modeling’,

We’ll fix the code snippet on the hub.

2 Likes