Hi, I was wondering if anyone could provide any insight into the most effective/efficient way of implementing finetuning with the HuggingFace Trainer module while incorporating two distinct datasets. Basically, I am looking for a way to have it so that the finetuning process goes over two distinct s…

Implementation of Two Distinct Datasets with HuggingFace Trainer Module

rkabir June 18, 2025, 5:23pm 4

Would I have to override the .inner_training_loop() method in order to iterate over each set per epoch? Or is there another way to do this?

1 Like

Topic		Replies	Views
Multi-Task dataset with Custom Sampler and Sharding Intermediate	4	1375	August 1, 2023
Update different parts of the model with different dataset Intermediate	0	36	August 13, 2024
Training using multiple GPUs Beginners	20	20109	February 25, 2024
Training on multiple datasets Beginners	0	482	January 23, 2024
How to run validation on multiple evaluation datasets simultaneously during Qwen2.5-VL-7B-Instruct fine-tuning? 🤗Transformers	2	23	August 10, 2025