From_single_file dtype issue

I am trying to read the pipeline from files on my filesystem:

base = StableDiffusionXLPipeline.from_single_file(
     "/path/to/sd_xl_base_1.0.safetensors", torch_dtype=torch.float16, variant="fp16", 
     use_safetensors=True
).to("cuda")

However, I kept getting the following error:

Traceback (most recent call last):
  File "/load_model.py", line 19, in <module>
    base = StableDiffusionXLPipeline.from_single_file(
  File "/opt/conda/lib/python3.8/site-packages/diffusers/loaders/single_file.py", line 261, in from_single_file
    pipe = download_from_original_stable_diffusion_ckpt(
  File "/opt/conda/lib/python3.8/site-packages/diffusers/pipelines/stable_diffusion/convert_from_ckpt.py", line 1252, in download_from_original_stable_diffusion_ckpt
    checkpoint = safe_load(checkpoint_path_or_dict, device="cpu")
  File "/opt/conda/lib/python3.8/site-packages/safetensors/torch.py", line 310, in load_file
    result[k] = f.get_tensor(k)
RuntimeError: Viewing a tensor as a new dtype with a different number of bytes per element is not supported.

I have a L4 GPU and I tested runwayml/stable-diffusion-v1-5 using ComfyUI, but it doesn’t work with SDXL.

Appreciate any help in advance!