How to use GPT4 with trl PPO script

Intermediate
1

I want to use the GPT4 model with this script: trl/examples/scripts/ppo.py at main · huggingface/trl · GitHub. However, I could not add GPT models to the pipeline as a reward model from outside of hugging face models.