For a Neural Machine Translation (NMT) task, my input data has relational information. This relation could be modelled using a graphical structure. Some researchers have tried to exploit transformer for graph data. For example, here is one paper.
I want to use Transformer. But then the challenge is how can I embed structural information there? Is there any open source artefact for Relational Transformer that I can use out of the box?