Whisper encoder

How can I only use a whisper pre-trained encoder only?