Can't load tokenizer using from_pretrained, please update its configuration: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 560, column 3 Here are my project files: Files . I could use the model locally from the local checkpoint folder after the finetune; however,…

Can't load tokenizer using from_pretrained, Inference API

nielsr May 6, 2024, 9:00am 2

Thanks for reporting, will forward to the team!

Topic		Replies	Views
Huggingface inference API issue 🤗Tokenizers	0	514	January 10, 2023
Tokenizer is not being loaded on Huggingface Inference 🤗Tokenizers	0	1005	September 22, 2022
Can't load tokenizer using from_pretrained, Interface API 🤗Tokenizers	0	329	May 21, 2024
Tokenizer issue in Huggingface Inference on uploaded models Beginners	7	3071	January 9, 2024
Hosted Inference API: Error loading tokenizer Can't load config 🤗Transformers	2	1016	July 16, 2020