ValueError: Unrecognized model in ./trained_model. Should have a `model_type` key in its config.json

John6666 · January 6, 2025, 11:55am

Hmm, transformers seems the most suspicious…

pip install -U transformers accelerate peft huggingface_hub

github.com/huggingface/transformers

ValueError: Unrecognized model. Should have a model_type key in its config.json

opened 10:26PM - 24 Aug 24 UTC

closed 08:04AM - 02 Oct 24 UTC

LujainAlawwad

I have trained a custom transformer model as a sequence-to-sequence model, did n…ot finetune an LLM. My config doesn't specify the model-type, it is as follows: config = { "architecture": "Seq2SeqTransformer", "vocab_size": tokenizer.vocab_size, "d_model": d_model, "num_layers": num_layers, "num_heads": num_heads, "dim_feedforward": dim_feedforward, "save_steps": save_steps } But when I try to load it from huggingface, it gives me this error: **Lu...... Should have a model_type key in its config.json, or contain one of the following strings in its name: albert, align, altclip......** I do not know which type should be specified. Please find the layout of my work in this notebook: https://colab.research.google.com/drive/1qwT4mqaTPoVW7HwlWNRKheR7FAzIdR-L#scrollTo=DtU3whBevE31

Topic		Replies	Views
"ValueError: Unrecognized model type" when loading my trained custom model 🤗Transformers	3	2432	August 13, 2024
ValueError: Unrecognized model identifier Models	1	2521	August 10, 2023
How to load model after running Trainer.save_model? Beginners	3	3077	November 28, 2023
Should have a `model_type` key in its config.json 🤗Tokenizers	0	1866	September 20, 2021
Trouble saving and loading a finetuned model Beginners	1	293	July 7, 2024

ValueError: Unrecognized model in ./trained_model. Should have a `model_type` key in its config.json

Related topics