How to properly instantiate an untrained model (model with randomly generated weights)

🤗Transformers
1

Hello!

I’m trying to train a Whisper model from scratch. The NLP course describes this way of instantiating an untrained model:

from transformers import WhisperConfig, WhisperModel

model_name = "openai/whisper-tiny"

configuration = WhisperConfig.from_pretrained(model_name)
model = WhisperModel(configuration)

nut when I try:

model.generation_config.language = "hindi"
model.generation_config.task = "transcribe"

model.generation_config.forced_decoder_ids = None

get an exception:

---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
Cell In[19], line 1
----> 1 model.generation_config.language = "hindi"
      2 model.generation_config.task = "transcribe"
      4 model.generation_config.forced_decoder_ids = None

AttributeError: 'NoneType' object has no attribute 'language'