I performed fine tuning flan-t5-small using peft. here is my code #loading dataset huggingface_dataset_name = "knkarthick/dialogsum" dataset = load_dataset(huggingface_dataset_name) dataset #loading original model model_name='google/flan-t5-base' original_model = AutoModelForSeq2SeqLM.from_pret…

Perhaps same error? [image] Transformer's trainer runtime error 🤗Transformers I performed fine tuning flan-t5-base model using peft. here is my peft config code peft_model = get_peft_model(original_model, lora_config).to('cuda') output_dir =…

Transformer's Trainer Memory shared Error

🤗Transformers

spencer1129 December 5, 2024, 10:29am 3

Perfect. Cool!
Thank you for your contribute.
And I was wondering if you could give me brief explain about why it is working.

1 Like

Topic		Replies	Views
Transformer's trainer runtime error 🤗Transformers	1	105	December 5, 2024
Saving model in safetensors format through Trainer fails for Gemma 2 due to shared tensors 🤗Transformers	5	1491	September 30, 2024
RuntimeError When Saving Phi 3.5 Vision Due to Shared Tensors 🤗Transformers	1	260	November 9, 2024
Using Trainer to save a Bartforsequenceclassification model Beginners	3	2155	August 13, 2024
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:7 and cuda:0! 🤗Transformers	2	197	March 25, 2025

Transformer's Trainer Memory shared Error

Related topics