Hugging Face Forums
Code RuntimeError:Multi-card operation
🤗Accelerate
ofir408
March 9, 2024, 12:20am
2
@zhangzhang9999
Hi, I have the same error. How did you solve it?
show post in topic
Related topics
Topic
Replies
Views
Activity
Accelerate multi-gpu error: Assertion index >= -sizes[i] && index < sizes[i] && "index out of bounds"
🤗Accelerate
0
439
March 8, 2024
RuntimeError: CUDA error: device-side assert triggered 4x10
🤗Transformers
0
177
April 11, 2024
RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with `TORCH_USE_CU
🤗Transformers
2
1119
November 1, 2024
Tokenizer setting for model = LlamaForCausalLM.from_pretrained(model_path, device_map='auto')
Models
0
1127
August 25, 2023
Multi-GPU Training sometimes working with 2GPU, but never more than 2
🤗Accelerate
5
3013
August 8, 2024