Looks like this is the way to load it with from_pretrained
new_config=PretrainedConfig.from_pretrained('./PATH/')
new_model=CustomClass.from_pretrained(pretrained_model_name_or_path='./PATH/', config=new_config, num_labels=100)
I have to verify the weights are also loaded successfully.