Get text generation in particular format

[RaushanTurganbay]

If you want compatibility with transformers, look into this which implemented constraints as a separate LogitsProcessor. I believe it should be compatible by simply passing logits_processor=[grammar_processor] into model.generate()