How to load local config.json for OneFormerImageProcessor without invoking huggingfacehub downloader

When I try to load a custom local config file like with

from transformers import OneFormerProcessor
OneFormerProcessor.from_pretrained(config_path, ignore_mismatched_sizes=True)ignore_mismatched_sizes=True) 

The downloader gets invoked when it shouldn’t, it should just load the and use the custom config file. I had to specify a value for the repo_id config key and when I put “dummy_repo” it looks like this is a required config for some reason.

            + f"Repository Not Found for url: {response.url}."
            + "\nPlease make sure you specified the correct `repo_id` and"
            " `repo_type`.\nIf you are trying to access a private or gated repo,"
            " make sure you are authenticated."

Is there something else I need to be doing to load a custom, local config file? I don’t have a need right now to upload/register anything so would like to avoid a solution like this: python - Save a Bert model with custom forward function and heads on Hugginface - Stack Overflow