Hi All,
How are you?
Working on TTS problem I would like to report WER per sample and save it as DataFrame at the end of the evaluation step. The DataFrame columns would be: sample name / path | prediction | target | WER.
I tried to use a custom callback but the metrics are already aggregated and I do not want to perform the evaluation twice. Another approach would be to re-write the Trainer’s evaluation loop but we want to avoid that.
What are my options?
Cheers,