TRL Apply Chat Template Error

I’m new to TRL CLI. I’m trying to follow this example for fine tuning, and I’m running into the following error:

ValueError: Cannot use apply_chat_template() because tokenizer.chat_template is not set and no template argument was passed!

How can I set a chat template during fine tuning?