Using the .generate() function with a custom model class

aneeshjain · March 3, 2023, 6:13am

Hi,

Im trying to use the .generate() function with a custom model class I have implemented. I want to use the generate function available within HuggingFace instead of implementing my own greedy/beam search functions. Is it possible to do this? I have been unable to find any documentation that describes how to do this.

Topic		Replies	Views
Using huggingface generate() with custom model 🤗Transformers	1	1756	August 26, 2023
How to override model.generate() 🤗Transformers	1	808	October 30, 2023
Custom model.generate() parameters for hosted models Beginners	0	430	October 7, 2021
Using custom models (not necessarily transformer based) with generate() and sampling Beginners	2	1126	March 1, 2022
Stopping `model.generate()` based on custom token Intermediate	2	4151	October 18, 2021

Using the .generate() function with a custom model class

Related topics