I am fine tuning custom dataset using this link https://huggingface.co/transformers/master/custom_datasets.html it is saving too many checkpoints that make my disk full, any suggestions? thanks

Checkpoints and disk storage

shainaraza October 8, 2020, 1:21pm 6

thanks for information, I am looking into the doc

Topic		Replies	Views
Saving only the best performing checkpoint 🤗Transformers	19	18239	May 23, 2023
Save only best model in Trainer 🤗Transformers	31	85801	June 25, 2024
Question Regarding trainer arguments:: load_best_model_at_end Beginners	2	1958	April 19, 2021
How to prevent too many checkpoints with run_clm.py? Beginners	5	1309	December 14, 2022
Checkpoint missing Optimizer.pt? How to Resume? 🤗Transformers	7	5501	May 18, 2021