Issue with Deploying LoRA-adapted Model on Hugging Face Endpoint

[John6666]

I fine-tuned it using Unsloth with LoRA adapters

Hugging Face TGI (body of Endpoint) supports only safetensors basically.
So possibly this issue?

LORA Adapated Deepseek R1 not working with inference endpoints

I used a standard LORA adapter training pipeline to train the deepseek-ai/DeepSeek-R1-Distill-Llama-8B model. I then stored the model on the huggingface hub using the model.push_to_hub_merged() method. I then wanted to use huggingface inference endpoints to load the model and I kept getting an error. I shall link my model as well as the error I am getting, any help would be appreciated, thanks! Name of model - bhaskars113/DeepSeek-R1-Entity-8B-V1.1 Error: Apr 02, 16:20:29 WARN BREAKING CHA…