Hello everyone, I am encountering an error when training my language model from scratch, having trained a tokenizer beforehand. I have just trained my tokenizer from scratch on a WordPiece model like BERT, following this notebook: notebooks/tokenizer_training.ipynb at master · huggingface/notebook…

[HELP] RuntimeError: CUDA error - when training my model?

anon58275033 August 24, 2021, 4:30pm 3

@lvwerra Hi, sorry for the late reply. I am still getting the error.

Topic		Replies	Views
[HELP] RuntimeError: CUDA error: device-side assert triggered Beginners	20	54477	October 23, 2024
Tokenizer setting for model = LlamaForCausalLM.from_pretrained(model_path, device_map='auto') Models	0	1129	August 25, 2023
I am getting Runtime error when i am trying to fine tune the Code LLama on custom dataset Intermediate	0	17	July 26, 2024
Bypassing "CUDA error: unspecified launch failure" error from trainer checkpoint loading 🤗Transformers	0	213	July 11, 2024
RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with `TORCH_USE_CU 🤗Transformers	2	1158	November 1, 2024