How to concatenate additional features to the last layer of Bert

[orko]

@nielsr Thanks, it is working great, just a few questions about ur notebook:

Google Colaboratory

1. In CustomSequenceClassification, why do you need to call post_init()?
2. Lets say that in the input, instead of a single sentence I want to insert two sentences (“This is a sentence 1”, “This is a sentence 2”) , how would you do it?

Also, if you could please help with an additional question I just posted it would be highly appreciated…

Add per-word embedding from outer source to Bert embedding layer

Hi I have an outer source with per-word embedding, I want to add it as an additional later for the bert embddings: Such that custom_embedding_layer = (word_embeddings)+(position_embeddings)+(outersource_embeddings) How can I do it? Thanks

Thanks