How does one even evaluate a fine-tuned model? I don’t want to evaluate it during training to keep things modular and since things take a while. I have been using a Triplet dataset for embedding that basically has a question, positive example and a negative example. This is my code for evaluating s…

Embedding evaluation

Felix-K404 January 8, 2025, 1:44pm 3

Shouldn’t be the case. The GPU got 12 GB and the data isn’t that large either.

1 Like