Adding categorical and numerical data to Bert model

Hello everyone,
I am trying to perform a multiclass text classification, and I am using, as stated in the title, TFBertForSequenceClassification, and more specifically the bert-base-multilingual-uncased (all my text data is lowercase).
I learnt how to use the model after having followed the tutorials, however I think the model would benefit of additional numerical and categorical data, which I am discarding because I don’t know how to add it.
I have already seen a post in which it is explained how to create a custom model, however the code uses pytorch that I don’t know yet ( I am learning tensorflow so I feel comfortable with it), so I a not able to get value out of it.
Could someone help me on this topic?
Thank you

1 Like