How to change the linear classifier?

@BramVanroy I am attempting to do something similar. Can you provide some feedback about Extending a pretrained model ?