How to change whisper's feature extractor?

At present, I have fine-tuned a code-switching model with LID. I want to further improve the accuracy rate, so I want to change the way of feature extraction and use wavLM and wac2vec2.0 to deal with it. I don’t know if this method is Is it possible, and if so, what should I do, and where should I pay attention?