ClientErro:400 when using batch transformer for inference

Hi @marshmellow77 , thank you for leading me into thought of sub-word tokenization .