Distilbert customize model

is it possible to create distilbert customize model??? i mean if i want to change from pretrained distilbert model what should i do???