Hi all,
does a model need to have good performance to consider their embedding layer output as new set of features? I was planning to extract the embeddings of my fine tuned Bert model and use them as input for PyCaret training, but my model is not performing well. So I am not sure if the embeddings of the model is any good.
Please share your thoughts.
Thanks in advance!