Hell everyone! I’ve been trying to finetune a GPT based model using SFT trainer from TRl library. it is my understanding that you could directly pass a non-tokenized dataset and the SFT trainer class handles the tokenization internally. However after defining my dataset(with only one row named “te…

Finetuning with SFTtrainer

nielsr June 12, 2024, 2:16pm 2

Topic		Replies	Views
Fine tune with SFTTrainer Intermediate	17	9725	September 12, 2024
Error using SFTTrainer: Make sure that your dataset has enough samples to at least yield one packed sequence Beginners	9	2565	November 1, 2024
Anyone have idea how we can finetune a model using Trainer API? 🤗Transformers	0	432	April 22, 2022
Questions when doing Transformer-XL Finetune with Trainer Beginners	3	1039	October 6, 2021
Filtering Sampled for Sequence Length 🤗Transformers	0	54	November 16, 2024