@nielsr Hi, I’m currently trying to build an OCR (text-recognition model), which gets the visual and contextual features via a transformer architecture. Currently my architecture looks like this: Visual features: DeiT FeatureExtractor (can it be that this is just a preprocessing instance for the …

Extract visual and contextual features from images

Felix92 August 27, 2021, 1:23pm 6

Input Example after FeatureExtractor:

Topic		Replies	Views
Why TrOCR processor has a feature extractor? Beginners	8	1454	November 25, 2021
Image Features as Model Input Beginners	2	940	November 18, 2020
Using trasnsformer to get image features 🤗Transformers	3	3378	March 20, 2024
Img2seq model with pretrained weights Beginners	7	1248	November 18, 2021
Get output embedding of FeatureExtractor 🤗Transformers	1	716	April 20, 2021