Getting this warning while loading fine-tuned Gemma2-2b model. And getting weird outputs too when go with this Some weights of the model checkpoint at <model_dir> were not used when initializing Gemma2ForCausalLM

Issue while loading file-tuned gemma2

Sidakdeep22 December 24, 2024, 4:01am 3

@amanpreetsingh459 I’m facing the same issue. How did you resolve it?

1 Like

Topic		Replies	Views
Unable to load checkpoint after finetuning Intermediate	5	4742	February 21, 2024
"Some weights were not used" message with AutoModel Beginners	4	1987	May 21, 2024
Assistance Needed: Unrecognized Model Error in AutoTokenizer.from_pretrained for Gemma-2-2B Beginners	3	305	February 11, 2025
GPT2LMHeadModel.from_pretrained('gpt2') not loading attn weights Beginners	1	2121	July 22, 2020
Can't load my model from pipeline Beginners	3	1780	June 20, 2024