How do I add an input embedding layer to transformer

[Hatman]

This is cool but I don’t know if I’m really understanding it. You’re wanting to add a Layer like in Keras? You might try something like this for embeddings.