Hello everyone I have been using the Autotrain advanced UI to try to train XLnet on a dataset and have been getting this error.
ERROR | 2023-12-31 19:09:01 | autotrain.trainers.common:wrapper:90 - train has failed due to an exception: Traceback (most recent call last):
File “/app/src/autotrain/trainers/common.py”, line 87, in wrapper
return func(*args, **kwargs)
File “/app/src/autotrain/trainers/clm/main.py”, line 254, in train
model = get_peft_model(model, peft_config)
File “/app/env/lib/python3.10/site-packages/peft/mapping.py”, line 133, in get_peft_model
return MODEL_TYPE_TO_PEFT_MODEL_MAPPING[peft_config.task_type](model, peft_config, adapter_name=adapter_name)
File “/app/env/lib/python3.10/site-packages/peft/peft_model.py”, line 1043, in init
super().init(model, peft_config, adapter_name)
File “/app/env/lib/python3.10/site-packages/peft/peft_model.py”, line 125, in init
self.base_model = cls(model, {adapter_name: peft_config}, adapter_name)
File “/app/env/lib/python3.10/site-packages/peft/tuners/lora/model.py”, line 111, in init
super().init(model, config, adapter_name)
File “/app/env/lib/python3.10/site-packages/peft/tuners/tuners_utils.py”, line 90, in init
self.inject_adapter(self.model, adapter_name)
File “/app/env/lib/python3.10/site-packages/peft/tuners/tuners_utils.py”, line 217, in inject_adapter
peft_config = self._prepare_adapter_config(peft_config, model_config)
File “/app/env/lib/python3.10/site-packages/peft/tuners/lora/model.py”, line 423, in _prepare_adapter_config
raise ValueError(“Please specify target_modules in peft_config”)
ValueError: Please specify target_modules in peft_config
ERROR | 2023-12-31 19:09:01 | autotrain.trainers.common:wrapper:91 - Please specify target_modules in peft_config
I assume it has to do with the training parameters spesificly the |“target_modules”: “”,| section but im not sure what to put in to make it work.