I’m attempting to fine-tune a Llama-2-7b-hf model to be predict quantities (in g or ml) of ingredients in a recipe. For example: Inputs to model: Name of dish or drink: harissa chicken traybake List of ingredients: [chicken legs, harissa paste, garlic, lemon, cherry tomatoes, new potatoes, Kala…

Supervised Fine-tuning Trainer - Custom Loss Function

hongyeliu November 7, 2024, 1:59am 5

Would you mind share the full script?

Topic		Replies	Views
Supervised Fine-tuning Trainer - Loss function calculation Beginners	0	3343	September 6, 2023
What is the loss Function when fine-tuning LlamaV2 Models	0	2145	September 19, 2023
Create Custom Loss function for transformers using a diffusion model and CLIP Intermediate	0	549	February 19, 2024
Trainer API Error when Hyperparameter Tuning with Custom Loss Function Beginners	1	637	May 30, 2024
Create a weighted loss function to handle imbalance? 🤗Transformers	3	1434	May 21, 2025