I’m using Llama2-7b-chat-hf model and I keep running into many spelling issues. However, when I use the HuggingChat or any of the spaces, I don’t see the spelling issue. Wanted to know what are the tweaks required if any to correct the generation.
Here’s an example of the output…
The feature should enable customers to withdrw caha from their accounts through various channels, such as ATMs, branches, or online bankng . The ** featute** should provide real -time update s on account balance and transaction history.
I’m not using temperate at 0.7, do_sample as true, use_cache as true, early_stopping as true as well.