Hello! I have been experimenting with transformers library and I wanted to fine-tune GPT-2 with a new custom_loss function that basically adds the cosine similarity between a certain topic and the generated results (so it is penalizing if the generated phrase has a low cosine similarity with the to…

Difference between model.generate() and model() outputs

nielsr March 3, 2024, 9:27am 3

1 Like

Topic		Replies	Views
How to output loss from model.generate()? 🤗Transformers	15	4166	April 26, 2024
GPT-2 custom loss Models	0	425	July 18, 2022
Difference in trainer.predict() and model.generate() for LM 🤗Transformers	0	1331	July 5, 2023
Key Error 'loss' while fine tuning GPT-2 with the Trainer utility 🤗Transformers	9	7230	May 10, 2022
Loss from calling model and computing explicitly don't match Beginners	0	163	June 30, 2023