How can I use class_weights when training?

🤗Transformers
#1

I have an unbalanced dataset. When training I want to pass class_weights so the update for rare classes is highen than for large classes. How is this possible in HF with PyTorch?

Thanks
Philip

1 Like
#2

Answering my own question:
Subclass Trainer and override the compute_loss method (see example here).

1 Like
#3

Sorry I missed your question and didn’t point you to this directly.

1 Like
#4

No worries. You did on GitHub… :slight_smile: :+1:

#5

Hi @PhilipMay !Do you mind pasting an example please, as I don’t really understand the documentation