Extracting embeddings with distilbert? (in tensorflow)

You should use the model without head for this, given by the class TFAutoModel. Here you use a model for sequence classification.

1 Like