Hell everyone! I’ve been trying to finetune a GPT based model using SFT trainer from TRl library. it is my understanding that you could directly pass a non-tokenized dataset and the SFT trainer class handles the tokenization internally. However after defining my dataset(with only one row named “te…

Finetuning with SFTtrainer

nielsr June 12, 2024, 2:16pm 2

Topic		Replies	Views
Fine tune with SFTTrainer Intermediate	17	12590	September 12, 2024
SFT Trainer and chat templates Beginners	3	50	March 26, 2025
Error using SFTTrainer: Make sure that your dataset has enough samples to at least yield one packed sequence Beginners	9	2915	November 1, 2024
Anyone have idea how we can finetune a model using Trainer API? 🤗Transformers	0	443	April 22, 2022
Questions when doing Transformer-XL Finetune with Trainer Beginners	3	1053	October 6, 2021