How to finetune BERT on an ontology?


I finetune BERT on a classification TASK. I want to improve the model by using knowledge of an ontology in an owl format. So is it possible ?

How can I do that since BERT is pretrained on text ? Is pretraining on ontology possible ?