Hello, there
I wonder if the tokenizer of t51.1 is the same as that of normal t5.
Or is the pre-tokenization step not the same?
Hello, there
I wonder if the tokenizer of t51.1 is the same as that of normal t5.
Or is the pre-tokenization step not the same?