I am training a fine-tune of codellama using PEFT but not sure how to use the task_type parameter of LoraConfig. Should it be CAUSAL_LM or SEQ_2_SEQ_LM or something else? Does it have any affect? The goal of my model is to parse an input for independent clauses in a sentence. For example, it would …

Task_type parameter of LoraConfig

pursuitYP October 20, 2023, 3:11am 5

The task_type parameter is used in the superclass PeftConfig

5 Likes