How to finetune BERT on an ontology?

emmakelo · March 10, 2022, 10:46am

Hello,

I finetune BERT on a classification TASK. I want to improve the model by using knowledge of an ontology in an owl format. So is it possible ?

How can I do that since BERT is pretrained on text ? Is pretraining on ontology possible ?

Topic		Replies	Views
Fine-tuning BERT Model on domain specific language Models	1	1356	January 5, 2021
Fine tunning pretrained bert with new vocabulary Beginners	0	353	October 1, 2020
Is masking still used when finetuning a BERT model? Beginners	1	1131	July 29, 2020
Getting better sentence embeddings with BERT - is it just pretraining, or it is pretraining + fine tuning? Beginners	2	3019	March 2, 2021
Using EXTREMELY small dataset to finetune BERT 🤗Transformers	6	8653	February 1, 2023