Problem on inference using peft and DonUT

I trained a DonUT model to perform document extraction from receipt , after the training i tested the accuracy and everything was fine so i pushed the tokenizer and the model to hub

But when i call it from hub the model behave as if it was never trained , the results are not even coherents . This happens only with the peft finetuned model . I have done a full finetuning just before and everything is fine

Link to the source code