Hello! I have been experimenting with transformers library and I wanted to fine-tune GPT-2 with a new custom_loss function that basically adds the cosine similarity between a certain topic and the generated results (so it is penalizing if the generated phrase has a low cosine similarity with the to…

Difference between model.generate() and model() outputs

nielsr March 3, 2024, 9:27am 3

1 Like

Topic		Replies	Views
How to output loss from model.generate()? 🤗Transformers	16	5828	January 7, 2025
GPT-2 custom loss Models	0	486	July 18, 2022
Difference in trainer.predict() and model.generate() for LM 🤗Transformers	0	1740	July 5, 2023
Finetuning GPT2 with user defined loss Beginners	56	16052	July 23, 2023
Logits from generate and model call different 🤗Transformers	2	857	January 26, 2025