Embedding layer or last hidden_hidden_state

Hey guys, I’m wondering which way is better to get the word embedding, embedding layer from the model used, or last_hidden_states after calling the forward() function of the model?