Model Adaptation

Hello, the aim of this discussion is to share ideas. I would like to let’s say adapt some model for differents tasks(summarization, translation,…) while trying to find out how it works(evaluation part) by digging through the model or even the tool(e.g. which layer makes which decision that affect the model decision).
Anyone have idea to share about this. Which models are suitable and how can this be done.