Using hyperparameter-search in Trainer

Hi @scottire

Im new using wandb sweeps with transformers. I tried to use the example in the blog post and adjust it to multi-class text classification. However, I always run into two errors:

- With data collator function:
Run b4wuzajc errored: TypeError('expected Tensor as element 0 in argument 0, but got str')

- Without data collator function:
ValueError("Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length. Perhaps your features (text_cleanin this case) have excessive nesting (inputs typelistwhere typeint is expected).")

Here is the notebook. Happy to share some example data.
Would be really grateful if someone can tell me whats going on! Thanks guys.

1 Like