Is there any way to fine tuning model with existing embedding?

[Soggggg]

I already have embeddings, but for some historic reasons I lost raw text.
I want to fine tuning bert with these embeddings. However, the documentation only display how to use raw text to fine tuning. I wonder whether there is a method to use embeddings to proceed fine tuning?