Hugging Face Forums
How BitsAndBytesConfig use bnb_4bit_compute_dtype=torch.bfloat16 on gpu don't support torch.bfloat16
Beginners
mohamedemam
October 20, 2023, 11:05pm
1
is it convert to float16 when find doesn’t support bfloat16
Related Topics
Topic
Replies
Views
Activity
Changing bnb_4bit_compute_dtype
Beginners
0
7
July 18, 2024
Understanding how changing bnb_4bit_compute_dtype affects outputs
🤗Transformers
1
2908
February 10, 2024
Confused with setting up torch_dtype while using CPU as device
🤗Transformers
0
1872
October 12, 2022
Does autogpt-q require float16?
🤗Transformers
0
347
August 28, 2023
Float16 on CPU torch support
Beginners
0
597
January 16, 2024