Hi all!
I’m looking to try to plot a learning curve that has either recall/sensitivity or F1-measure on the y-axis (accuracy is acceptable but not ideal) with the x-axis as an increasing number of samples/data points for the finetuning a model for text classification. I was looking at scikit-learn and was able to learn how to make curves off for kNN and other things and pipelines that are scikit-learn specific but I couldn’t figure out how to use it for the transformers model, and didn’t see anything on the internet that had what I needed. Has anyone done this and would they be willing to share what they did in their code?
Full disclosure, I am a beginner in HuggingFace in general, and coding abilities as well. Links to guides would be so welcome!