When I freshly train the Token Classification model (DistilBertForTokenClassification) and run a prediction for a single sentence that I manually type out, it runs fine, but when I try to run it on my dataset, it fails with RuntimeError: CUDA error: device-side assert triggered when using. This is …

RuntimeError: CUDA error: device-side assert triggered

iHesam April 28, 2021, 8:04am 2

This could be due to various reasons. Please run your code on the CPU to get a specific error message.

Topic		Replies	Views
Fine-tuning: Token Classification with W-NUT Emerging Entities Beginners	4	700	October 13, 2021
[HELP] RuntimeError: CUDA error: device-side assert triggered Beginners	20	54874	October 23, 2024
RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with `TORCH_USE_CU 🤗Transformers	2	1226	November 1, 2024
How to do inference with fined-tuned huggingface models? 🤗Transformers	3	822	February 4, 2024
CUDA error: device-side assert triggered 🤗Transformers	3	4278	June 4, 2021