I’ve been fine-tuning Llama-2 using LoRA. The task is to classify the title into correct categories/extract relevant named entities.
However, when I ran the inference, Llama-2 always produces very unstable spellings although it was trained on another spelling.
Beauty products | Hand Cream
Beauty products | Hand Créme
Brand: Johnson & Johnson
Electronics | Tablet | Accessories
Electronics | Tablets | Accessaries
Do you know how to force Llama-2 to stay faithful to the input texts’ spellings?