Layer specific Fine Tuning whisper

Any idea how to do layer specific fine tuning of whisper . Most of Tutorial and blog fine tune includes updating all parameter … any tutorial , blog will be much appre appreciated