Hello! I have been experimenting with transformers library and I wanted to fine-tune GPT-2 with a new custom_loss function that basically adds the cosine similarity between a certain topic and the generated results (so it is penalizing if the generated phrase has a low cosine similarity with the to…

Difference between model.generate() and model() outputs

nielsr March 3, 2024, 9:27am 3

1 Like

Topic		Replies	Views
Difference in trainer.predict() and model.generate() for LM 🤗Transformers	0	1811	July 5, 2023
[Urgent] trainer.predict() and model.generate creates totally different predictions 🤗Transformers	4	6942	February 1, 2021
T5 forward pass versus generate, latter outputs non-sense Beginners	8	2916	March 25, 2021
Generate method during finetuning Beginners	6	1951	July 30, 2020
Can I get logits for each sequence I acqired from model.generate()? Beginners	1	1325	November 27, 2020