I am testing how to fine tune a model (phi3.5 mini) with autoTrain.
This is an dummy example of the data format I use (csv)
text
### User: What's the difference between "affect" and "effect"?\n\n### Assistant: "Affect" is typically used as a verb meaning to influence or make a difference to something, while "effect" is usually a noun meaning the result or consequence of an action. For example:\n- The rain affected our plans. (verb)\n- The effect of the rain was that we stayed indoors. (noun)\nHowever, "effect" can also be used as a verb meaning to bring about or cause, and "affect" can be a noun in psychology, referring to emotion or desire. These uses are less common.
My question is if I also need to add special prefix and suffix like i.e. <|user|>
to the dataset? When I chat with the model it is required else the model does not understand, so do I need to have it also in the dataset?
Thank you in advance!