Using hyperparameter-search in Trainer

dunalduck0 December 7, 2021, 7:39am 81

I’d like to do hyperparameter search for GPT model. Can someone advise what I should use to create compute_metrics() for trainer.hyperparameter_search()?

Topic		Replies	Views
There is always something going wrong with hyper parameter tuning 🤗Transformers	4	1983	September 1, 2021
Hyperparameter search with wandb 🤗Transformers	1	233	July 28, 2024
Trainer.Hyperparameter_search() Trials did not complete. How to optimize parameters with ray tune? Beginners	0	941	January 10, 2023
Trainer.hyperparameter_search doesn't work for me Beginners	2	518	December 22, 2020
Hyper params search for model config 🤗Transformers	0	173	February 22, 2024

Using hyperparameter-search in Trainer

Related topics