Hello! I have a custom model that I train and also would like to test within the HF environment. However it seems that even tho I pass a custom compute_metrics function to my trainer it doesn’t call it once. This is my code: def plot_covariance_matrix(model_output, config): print(“Hello World!”) …

Trainer doesn't call compute_metrics during evaluation

filbeofITK June 24, 2024, 2:49pm 3

No sadly I had to write my own evaluation methods.

Topic		Replies	Views
Trainer never invokes compute_metrics Beginners	7	7617	July 25, 2025
Transformer Trainer no response when evaluate with compute_metrics 🤗Transformers	1	170	September 12, 2024
How to define the compute_metrics() function in Trainer? 🤗Transformers	3	16757	December 20, 2021
Custom model for Trainer 🤗Transformers	1	390	July 8, 2023
Compute_metrics caused training stopped during evalauation 🤗Transformers	0	373	November 16, 2022