Hello, I was reviewing the prompt-tuning tutorial here:
I was wondering how to introduce several task.
My idea is use the aya_collection to create an instruct model. I was wondering how to septup the prompt tuning to have soft prompts for each task on the dataset.
My issue is with this part of the code in the tutorial
peft_config = PromptTuningConfig(
task_type=TaskType.CAUSAL_LM,
prompt_tuning_init=PromptTuningInit.TEXT,
num_virtual_tokens=8,
prompt_tuning_init_text="Classify if the tweet is a complaint or not:",
tokenizer_name_or_path=model_name_or_path,
)
It seems that there is a string as input. How should I introduce other task?
Thanks