Using the .generate() function with a custom model class

Hi,

Im trying to use the .generate() function with a custom model class I have implemented. I want to use the generate function available within HuggingFace instead of implementing my own greedy/beam search functions. Is it possible to do this? I have been unable to find any documentation that describes how to do this.

2 Likes