Fine-Tune TrOCR on Arabic

Beginners
1

I am trying to fine-tune TrOCR on Arabic, I followed TrOCR Fine-Tune Tutorials by @NielsRogge, choose a suitable encoder/decoder option suggested by @NielsRogge on discussion board but I get very high WER score and the generated text is gibberish, I tried the pytorch implementation and it generated text prediction to continue the sentence instead of writing the sentence in the image.

Notebook of Code

1 Like
2

It seems you have a configuration issue

image
image1101Ă—251 23.5 KB

1 Like
3

how should
I fix it?

4

did you arrive to a solution ?
check mine and tell me : (successful run)HandWritten-OCR-TrOCR (kaggle.com)