Load custom model trained with trainer

Hi, I am new to the HF library. I was training BERT from scrath for a task that was not related to NLP but sequence classification. I have succesfully trained BERT with a custom number of neurons at the output layer (21 to be precise). I have downloaded every single file inside the folder that was created as a checkpoint, is that enough to load my model? Because I can see that there are files that indicate to contain the model’s weights. If I can load the model, how do I do it? I have been researching but I could not find anything.
Thank you.