hey @imtrying, if you saved the model using the Trainer you should be able to use the from_pretrained function to load the model as follows:
# pick the appropriate Auto class for your task
from transformers import AutoModel
model = AutoModel.from_pretrained("path/to/folder/where/you/saved/your/model")
if that doesn’t work, perhaps you can share which version of transformers you are using and how you created the Trainer?