How do i get bare bones of ViT transformers

Beginners
1

I want to have the ViT model’s version where it isnt trained.So basically that just the code for it.How can i do this? Im new so i have no clue help me out please

2

I bet you want the default setting of ViT model in huggingface. You may try:

from transformers import ViTModel, ViTConfig

print(ViTModel(ViTConfig()))

3

Yeah I figured that out, but how to I proceed from there for training ?

4

Maybe you can take a look on this tutorial?

5

This seems to be using a pre-trained version by what I could see