Hello,
How can I know which tokenizers, e.g. DistilBertTokenizerFast or WhisperTokenizer can be used as a keras layer in my model? This will help me package both the tokenizer as well as the model together.
Hello,
How can I know which tokenizers, e.g. DistilBertTokenizerFast or WhisperTokenizer can be used as a keras layer in my model? This will help me package both the tokenizer as well as the model together.