Data security with Open model

I am new and exploring some Open model like Dolly2.0. I have a question, If I am going to use the pre-trained open model like Dolly2.0 and finetune with my Data set. In this case my data would be shared with base model or not? I don’t want to share my data out of my company boundary.